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ABSTRACT 

The study discusses the problem of reporting program 
development costs and estimating service delivery cost. One adequate 
system is described. Based on field investigations, that system is 
compared with those of the National Institute of Education (NTE) 
career education projects. Chapter two contains a discussion of cost 
related concepts and chapter three specifies a framework for cost 
reporting of program development. It is suggested that costs be 
reported in a framework of the development activities and the 
products and subproducts of that activity. Chapter four discusses 
estimation of program service delivery costs. An exploratory and 
incremental estimate is suggested. Due to the difficulty of 
separating developmental from adopter activities and cost, an upper 
and lower estimate is utilized. Modifications to the cost collection 
and reporting system of chapter three are specified. These are in the 
direction of providing greater detail through specification of the 
components which describe the processes under development, chapters 
five through seven compare the accounting systems of the three 
Experience Based Career Education (EBCE) models with that which 
evolved from chapters three and four. Chapter six encompasses the 
system of all four EBCE projects. Chapter eight contains conclusions, 
recommendations, and suggestions for future work. (Author/HW) 
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EXECUTIVE SUMMARY 



Reporting program development costs requires that 
those activities which are significant be defined and 
costed. Some activities can be unambiguously traced to 
processes associated with developing the primary product (s), 
technique (s ) , and material (s) which define the objective 
of research and development projects. Such activities 
give rise to direct costs. Other activities are secondary 
to or supportive of those traced directly to the develop- 
ment process and give rise to indirect costs. Both kinds 
of activity should be defined, and resource allocation and 
cost should be traced to them. In Chapter Three, ten such 
activities are defined: 



1. 


Design 


2. 


Application , 


3. 


Evaluation 


4. 


Product Finishing 


5. 


Documentation 


6. 


Replication/Diffusion 


7. 


Fundor Negotiation and Liaison 


8. 


Site Negotiation and Liaison 


9. 


Staff Recruitment and Training 


10. 


General Management, Housekeeping, and Clerical 



These activities are sufficiently broad to apply to 
any development effort. They are recommended as Standard 
Cost Categories. 

Costs should also be traced to the budgetary work units 
which characterize particular development projects. These 
should include the major research and development products. 
Where products are significant and complex, their component 
subproducts should be specified. 

Collection of costs in the dimensions of Standard Cost 
Categories and of program products and their components 
makes possible the reporting of program development costs 
in terms of the research and development activities for 
each product and subproduct. Such a system will record the 
evolution of cost as products and subproducts move through 
developmental stages. 

Such a system also provides the basic framework for 
constructing estimates of adopter reso'irce requirements 
and of corresponding costs when the program is transferred 
from its developmental sotting. The primary additional 
data collection requirement is expansion in the recording 
and reporting detail of product and subproduct resource 
requirements and costs. Each produc t/subproduct should be 



described in terms of t\ *j major service components which 
compose it. The results of applying resources to each 
component of the program under development must be re- 
tained* Detail should be sufficient to distinguish 
between the costs of program acquisition tasks and pro- 
gram operations. 

Vie recognize three possible levels of estimation 
complexity. The first and least complicated simply uses 
the record of developmental or field test experience, as 
collected above, to estimate adopter costs when the pro- 
gram is installed and operated at the same level of 
activity and with the same configuration of service 
components and treatment results which were present at 
the development site. 

Second , ^ adopters may wish to expand or contract the 
level of program activity while maintaining the same 
raixture and relative level of services and treatment 
results found at the developm^lt site. The problem here 
, is that some resource requirements and costs will not 
jchange over some ranges of program activity level modi- 
fication. These ranges over v;hich resource requirements 
are invariant in response to output must be specified. 

Finally, at a third level, the adopter may wish to 
modify the relative intensity, or mix, of different 
service and treatment components. To the problem just 
mentioned (invariance of fixed resource requirements) 
is added that of service component and treatment result 
interdependency . Because of the limited variety of 
program activity level and structure during develop- 
ment, estimates for the more complex circumstances 
require an increasing number of assumptions and an appli- 
cation of judgment. 

In the initial formulation of this report ,1 ARIES 
suggested an upper and lower estimate of adopter cost. 
Such a procedure establishes a ranc^e of expected cost. 
This suggestion v;as made in recognition of the unknown 
degree to which Design and Evaluation activity continue 
in adopter settings, and is felt to provide a more 
realistic estimate than a single point estimate. 

The initial report suggested that the lower estimate 
be based on the resources and cost of Application activity 
and that the upper estimate consist of Design and Evalua- 
tion activity in addition to that of Application. Based 
on subsequent work (see Appendix B) the range of variation 
between the lower and upper estimate of total annual costs 
would be the difference between $172,389 and $240,306, or 
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$67,925 for EBCE at Northwest Regional Educational 
Laboratory (NV7REL) . This is a 39 percent difference. 
Such a range is judged to be excessive. 

Therefore, the recomincndGd calculation of the upper 
estimate is amended. Costs arising due to personnel 
primarily assigned to Design or Evaluation are to be 
excluded. The resources and costs of the Design and 
Evaluation activity of operational staff remains. This 
procedure results in an upper estimate of EBCE costs at 
N\\fREL of $212,851. This provides a more meaningful esti- 
mate of cost range in ARIES' view. Annual per pupil cost 
estimates of operational cost at various enrollments are 
reproduced from Appendix B in Chart I below. 



Chart I 

Estimates of Per Pupil Annual 
Costs at Various Enrollments 

Enrollments 

Total 

Item Cost 50 64 75 100 



Lower Estimate $172,371 $3,446 $2,701 $2,585 $1,724 
Upper Estimate $212,851 $4,257 $3, 326 $3,193 $2,129 



The reader should refer to the Appendix for explanation 
and qualifications . 

Estimates appropriate to each of two situations should 
be provided. The first is an exploratory estimate . This 
is applicable to early discussion and exploration of pro- 
gram adoption. This estimate is constructed by the agency 
providing information to the adopter. The estimate includes 
all, or nearly all, program resource requirements valued at 
wagv^s, salaries and prices based on national adopter aver- 
ages. The exploratory estimate is expressed in dollar terms 

If the exploratory esti'Tiate presents a range of cost 
which is acceptable to the adopter, his investigation will 
proceed further. The adopter will wish to refine the explor 
atory estimates to fit his circumstances. Wages, salaries 
and prices from national averages should be adjusted to 
those found in his locality. Any resources which can be 
provided to the program at no additional cost due to prior 
availability at the adopter site should be eliminated. 
This is especially iikoly for machinery and buildings. 
The estimate so constructed is the adopter incremental 
estimate . 
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The incrementa.l estimates presented to the adopter should 
specify the kinds and types of resources required and the 
quantities of each allocated to the several elements of the 
prograra. Concern v/ith physical quantities should pracede 
application of monetary value in order to determine costs. 

Construction of the data system for providing the resource 
quantities and costs should be undertaken early in the develo p- 
mental proces s . Such a system would be based on a clear 
specification of the cost questions to be answered. The best 
possible jstimates could then be provided. However , the 
contractors for present career education research and devel- 
opment programs have already been operating for an extended 
time. When their cost reporting systems are compared with 
the system developed in this report, significant discrepan- 
cies are noted as a general rule. 

One of these is that secondary and supporting research 
and development activities are not fully reported. Another 
is that ''operations^* is not detailed sufficiently to fully 
describe program service components, and treatment results 
are not assigned to them. 

With respect to describing the component structure of 
their programs considerable diversity exists among contract- 
ors even when the products under development are similar. 
One possesses a system v;hich closely approximates the one 
we recommend. Another has little cost information beyond 
line item resource payment objects. 

Considerable diversity also exists among contractors 
with respect to the assignment of the payment object to 
reporting categories and the procedures used when costs 
are prorated . Considerable diversity also characterizes 
the procedures for reporting staff time, the cost of which 
is the largest component of expenditure. 

Contractors are willing to undertake additional 
calculations on the part of nondevelopmental staff in 
order to uniformly undertake cost allocation and proration. 
However , at this time , we feel there would be considerable 
resistance to those changes in the systems which record 
cost and resource allocation collection and which must be 
accommodated by developmental staff. 

Therefore, we recommend that contractors immediately 
begin~to proviac upper and lower estiir^ates of the acquisi - 
tion and operational costs at incremental and exploratory 
levels . ~I^^ri disclosure of "data sources , measurement 
processes , assumptions and calculation procedures should 
be made explicit. This must start with statements of 
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physical roquirements for significant resources. By starting 
now problems can be identified and the appropriate changes 
made. 

For purposes of exploratory estimates ^ we recommend 
adjustments for resource price differentials. This will 
require formation of national average wages ^ salaries ^ 
and prices for those same resources . 

For incremental cost estimates^ we recommend specifica- 
tion of the quantities of each of the resources for each 
of the program components in which they are employed. 

This is admittedly a halfv;ay house that stops short of 
presently imposing a more ideal system upon present contrac- 
tors. However ; even now^ a more ideal system could not 
fully compensate for lost data concerning acquisition tasks 
\rhich are not repeated. For most contractors, it will mean 
inability to assign costs to pror^ram service components and 
treatment results. The implication is that estimates of 
the cost effect of changes in program structure cannot be 
provided. Estimates for present activity levels and for 
program structure and extensions at changed activity levels 
with unchanged service can be. The advantage is that the 
estimation process can begin immediately. It will be a 
time consuming and arduous task* Should this process of 
estimation be found wanting, there may yet remain time for 
implementation of a better cost recording and reporting 
system, the need for which is then apparent. 
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Chapter One 



INTRODUCTION 

One of the most persistent problems of human service 
programs is tha^ of cost reporting and estimation. This is 
true for program.:: whether in a developmental or the opera- 
tional setting. 

For programs under development there are three cost 
problems. The first is to report the costs of program 
development to fundors and sponsors in a form which is 
consistent with the structure of the budgeting process 
The second is to report cojts in a manner such that esti- 
mates of service delivery cost can be constructed for 
use when contemplating adoption of the program in an opera- 
tional setting. A third problem is to assess the social 
value of the program, in order to determine whether it is 
more or less efficient relative to alternatives, and 
whether and to what degree its benefits exceed costs. 

These problems are not independent of one another. As 
listed they move from cost systems of less to those of 
more detail and scope. A s we shall see, a cost reporting 
system adequate for estimation of operational service 
delivery costs on the basis of devolopment experience ca n 
at the same time provide data required for the reportin g" 
o f program ae\/elopnent costs . Likewise a frequent criti- 
cism by those conducting ef f e-.tiveness and benefit/cost 
studies of human service programs is that the cost record 
is inadequate to do so. Cost reporting for estimation of 
operational costs v/ill contribu^.e to rectifying that weak- 
ness • 

This report concerns itself with the first two cost 
problems. Both of these treat costs similarly. In both 
problems the object of concern is expense. Both cost 
and transfer payments are included in expense. Also, the 
bounda ry of expense is the same for both. It is that of 
the funding or adopting agency. Expenses borne by third 
parties, directly or indirectly, are not included. 

Most benef i t/cost studies expand the boundaries of 
analysis from i he 1 indor or adopter to include all economic 
units in the economv. If the program imposes a cost paid 
by third parties outside the fundor or adopter payment 
systcn^, that cost is included by benefit/cost analysis. 
Such analysis also requires a persistent distinction 
between expense due to cost and that due to transfer pay- 
ments. Also, costs may or may not be those actually paid 
by the economic unit. The relevant cost concept is 



opportunity cost, the value of the loss in satisfaction 
occasioned by choosing one alternative (the developed pro- 
gram) over the next best alternative. Due both to the 
requirement that all costs (for example, those of employers 
and students) be accounted for and to the definition of 
cost as opportunity cost, the analyst must frequently 
construct cost values which are adjusted for distortions 
in the price system. These may be other than those actually 
observed or paid. Due to these factors, this study does not 
include data rep^-rting for benefit/cost analysis as a topic. 

Therefore, the study discusses the problem of reporting 
program development costs and estimating service delivery 
costs. One adequate system is described. Based on field 
investigations, that system is compared with those of the 
NIE career education projects. 

The remainder of the study proceeds as follows , 
Chapter Two contains a discussion of cost related concepts. 
Chapter Three specifics a framework for cost reporting of 
program development. We suggest that costs be reported 
in a framework of the development activities and the prod- 
ucts and subproducts of that activity. Chapter Four dis- 
cusses estimation of program service delivery costs. An 
exploratory and incremental estimate is suggested. Due to 
the difficulty of separating developmental from adopter 
activities and cost, an upper and lower estimate is utilized. 
Modifications to the cost collection and reporting system of 
Chapter Three are specified. These are in the direction of 
providing greater detail through specification of the com- 
ponents which describe the processes under development. 
Chapters Five through Seven compare the accounting systems 
of the three EBCE models with that which evolved from 
Chapters Three and Four. Of these, Chapter Six encompasses 
the system of all four Experience Based Career Education 
(EBCE) projects. Chapter Eight contains conclusions, 
recommendations, and suggestions for future work. 
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Chapter Two 



COST DEFINiTTONS AND CGNS IDCRA TIQNS 

This is a cost study. Cost is of interest to individuals 
of widely different interests. It is the object of study by 
at least two pro tessionai groups , accountants and economists • 
Cost would seem a simple concept, but, in fact, it is a subject 
of much complexity. Numerous distinctions and issues abound. 
Economists and accountants speak a somewhat different language. 
Therefore , a short discuss ion of common cost definitions and 
problems would seem in order. 

1: Origin and Definition of Cost 

Cost starts with an economic unit^ seeking to satisfy 
individual or group needs and wants. Doing so necessitates 
the use of labor, land, and capital (buildings, machinery, 
equipment, skills), and noncapital products or services. 
But products and services are themselves the result of apply- 
ing land, labor, Lnd capital in an organized manner. These 
essential requirements we call resources. 

Resources are of three general kinds. Land and labor 
have been mentioned. The third is capital — physical in the 
case of buildings, machinery and equipment and human in the 
case of skills and other capacities which are developed and 
maintained . 

One fundamental relationship is that which exists between 
the output of good or service produced or the need or want 
satisfied and the quantity of each of several resources 
required in order to achieve the given oiitput. Technology is 
the concept which describes the body of knowledge of such 
production relationships . 

As more of a product is produced, more of one or more 
resources will be required. This adjustment of resource 
quantity to output may be either continuous or discrete. For 
example, as more graduates are to be delivered from an educa- 
tional system, the number of texts generally increases contin- 
uously with the number of graduates but the number of classrooms 
increase discretely. One more graduate requires at least one 
more set of instructional materials but not necessarily one 



1. In elementary or economic theory this unit is either a 
consumer, a producer, or a resource ovmer- These are 
functionally defined so that the same person or group 
may act as a producer or resource owner. 
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more classroom. Resources which adjust only discretely with 
output and cannot be obtained in any desired quantity are said 
to have the characteristic of indivisibility . The contrast 
between divisible and indivisible resources is illustrated 
below. 



Divisible Resource 



Quantity of 
Divisible Resource 



35 - 
28 - 
21 - 
14 - 
7 - 



10 



20 



30 



40 



Output 
Quantity 



Indivisible Resource 

Quantity of 
Indivisible 
Resource 

35- —i 

28- ♦ 

21- , 

14- , 

7~ 

\ -\ \ 1 ^ 

0 10 20 30 40 Output 

Quantity 
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Cost is associated with resource utilization because 
resoa::ces are limited. Their allocation to satisfying one need 
or want implicitly noc;ates their use elsewhere. Thus, not all 
needs and wants can be simultaneously satisfied. This leads to 
resources being com.pensated. If present users do not provide 
sufficient rewards to the resources they employ, those users 
with deficient resources will offer inducements to attract 
additional quantities. These inducements may be objective in 
terms of products, services, or money, or subjective in terms 
of satisfaction itself. Regardless of the nature of induce- 
ment, its value will rise until present resource users are 
providing inducements greater than or equal to those which 
any denied but desiro,us user would be willing to offer. 

This discussion ,s superficial and oversimplified but it 
does lead to a definition of cost. Cost is the value of the 
inducement which, if provided, would secure the continued 
voluntary allocation of desirod quant ities of a resourc~to 
an economic activity ^ Cost, while not identical to resource , 
is a function of its use. 



II: Economic Value of Resource 
As Opportunity Cost 

Since there are not enough resources to simultaneously 
satisfy all demands, allocating a resource to one activity 
denies it to another. The output, or result, of the excluded 
activity is thus lost to society. This leads to the economic 
value of a resource as opportunity (foregone) cost . 

Opportunity cost is the highest value of alternative 
output, or results, lost due to the allocation of a resource 
to one activity and its corresponding denial to all others. 
The market price of a resource may or may not equal its oppor- 
tunity cost. 



Ill: Not All Payments Are Costs — Transfers 

Cost as a payment is to be distinguished from a transfer . 
A transfer payment is a gift . A transfer is a payment made to 
an economic unit which is not a direct inducement or compensa- 
tion as a consequence of tne unit offering up resources under 
its command. No resource allocation is made and there is no 
lost production- Hence, there is no opportunity cost. 
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IV: Expenses and Costs Are Not Identical 

Accountants discuss expenditures. An expenditure is any 
charge that results in the reduction of the net resources of 
the paying unit. In particular^ transfer payments are expend- 
itures of an expendable fund. Costs, of course, are also 
unless the particular economic unit avoids paying some cost 
as in the case of effects of pollution. That is, the payment 
to a resource may be less than, equal to, or greater than the 
true (economic) cost. 

The only problem is that in many discussions expenditures 
become equated with cost and then clarity vanishes. 

V: Cost and Expenditure 

A. Fixed and Variable Costs 

Economists divide costs into two kinds depending on 
the degree to which some resource requirements change 
when output is changed. The two broad categories are 
fixed cost and variable cost. 

Some costs are fixed costs. These are costs which 
do not vary as the level of production is changed. The 
cost of a building employed in an economic activity-^ is 
usually a fixed cost. Costs are fixed because the resource 
quantity is fixed. Chart I below portrays the relation of 
fixed cost to output. 



1. There are two fundamental economic activities, production 
and consumption • Production is the transformation of 
resources and preexisting products into a product through 
the application of technology. ( Technology is the know- 
ledge which specifies the quantities of resource,^ capable 
of producing each quantity of a given product. A pro - 
duction function specifics the miniTPum resource require- 
ments for the given product and output* ) Concumption is 
the direct transformation of products and/or resources 
into satisfaction of individual or group needs and wants. 
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Chart I 



Fixed Resource Requirements and Cost 
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start-up and Acquisition Costs Are Fixed Costs: 

At this point, we may distinguish two different 
sources of fixed cost . For a now enterprise or for a 
new product of an old enterprise there are at least: 
two elements. 

These are (1) those costs (and resource allocations) 
which are necessarily incurred prior to the point of 
volume production of the product and (2) those which 
are incurred subsequently • Start-up costs are those 
which are incurred prior to the point of volume pro- 
duction. These costs have two elements: Capital 
costs for machinery, buildings, etc, are one component. 
These are treated as are other capital costs. They 
are spread over many tim.e periods through depreciation. 
The remainder of start-up coHits will be noncapital 
costs , labor and short lived .'na terial s , necessary to 
establish and perfect the production process. These 
costs are also spoken of as start-up costs , They 
present an issue to the accountant since there is no 
clear rule for their treatment; they may be charged to 
a single period or spread over several years. 

Other writers have used terms other than start-up 
to refer to (the) costs which are due to the period 
prior to volume production • One we should mention is 
the term, acquisition costs. Acquisition costs are 
defined as the costs of all resources allocated in 
order to develop the capacity to produce some product 
or offer some service. 

Almost all writers use the term operational costs to 
describe the sum of all costs which occur subsequent 
to the point of volume production. 

Variable cost-^. are the second cost category of v/hich 
fixed cost was ti^e first. Variable costs are those 
which change*^ when output changes. Energy costs are 
illustrative of variable costs , As more is produced , 
more energy is required and energy costs increase. 
Chart II below portrays the relation of variable cost 
to output. 



1, The change may be either continuous or discrete. See 
page 4 . 
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Chart II 

Variable Resource Requirements and Cost 



Electricity 
(1000 KWH) 



A 




Units of 



Output 



Electricity Cozt 
($0.50/10 00 KWH) 




The sum of fixed costs and variable costs is total 
cost. Chart III portrays their relationship. Since 
variable cost changes as output changes, economists are 
much concerned with how total cost changes when output 
changes. Costs cannot be meaningfully discussed in 
isolation from output. 



Chart III 
Total Cost Requirements 
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B. Average Cost 



If one is interested in the cost to be allocated 
equally to each element of output, then one speaks of 
average, or unit cost. Average cost is simply total cost 
divided by the number of units of output.*^ The cost so 
divided may be fixed, variable or total. Diagrammaticaily 
average cost can be indicated by the slope of the line 
drawn between a point on the cost curve and the origin, 
or the tangent of the angle (9) so produced. In Chart IV, 
average cost is indicated by two levels of output, 10 units 
and 4 0 units. 



Chart IV 

Average 'Cost 
At 10 and 40 Units 
of Output 



Cost 
$70 - 




0 10 20 30 40 Units of Output 



1. Average cost at 6 units = $22 10 - $2.20/unit* 

2. Average cost at 40 units= $60 40 $1.50/unit. 



Iv I'his again emphasizes that a m.eaningful discussion of 

costs requires a clear undcrsta.nding not only of resource 

requirements but of results , or output . As before 

average cost usually changes in response to output changes. 
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Marginal Cost 



Economists drc also interested in tha change in cost 
due to changes in the quantity of output. The change in 
cost ( ^ C) divided by the change in output ( A ^) is , 
called marginal cost ( / A ^) • the change in 

output is made arbitrarily small, we speak of marginal 
cost at a given level of output. Its value is indicated 
by the slope of the tangent to the cost curve at the 
given output and associated cost. Chart V illustrates 
the concept of marginal cost and compares that with 
average cost. 



Chart V 

Marginal Cost and 
Average Cost at 4 0 
Units of Output 




10 20 30 40 Units of Output 



Average Cost = tangent = 6j0 = $1.50 (unit at output 

40 equal to 40. ) 



Marginal Cost - tangent 1^ - 32_ = $3 .20 (unit at output 

2 10 equal to 40. ) 
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D. Incremental Cost 



Incremental cost is a term related to marginal cost. 
Incremental cost is the change in cost associated with 
any change which affects the economic unit. Since one 
such variable is the level of service or output, marginal 
cost is one kind of incremental cost — the incremental 
cost due to a one unit change in output. 

Incremental cost is frequently applied when discussing 
the effect on total enterprise costs of adopting a new 
program, either through addition to or substitution for 
an existing one. The incremental cost will depend not 
only on the total cost of the new program taken in isola- 
tion but also on the configuration of resources already 
available at the adopter site. Already available resources 
reduce the cost of installation and operation to the 
adopter. 



VI: Cost Assignment 

If the economic entity giving rise to cost produces only 
one product through application of only one production process, 
then the cost of a given level of product or service is 
easily determined by adding fixed cost and variable cost. 
However, if more than one product, or service is produced or 
if it is produced in more than one way, the issue is less 
clear. Let us illustrate. Suppose a corporation produces 
two products, X and Y. (X could be college bound graduates. 
Y could be vocationally bound graduates.) Production takes 
place in the same building and is managed by a common corp- 
orate staff which makes overall decisions such as the output 
levels of X and Y and cares for payroll, taxation, hiring, 
etc. Now what is the total cost of product? 

A. Joint Costs 

Certainly one would start with the variable costs of 
product X, assuming that these can be clearly traced to 
X, but what about fixed costs? One could clearly assign 
some of them as due to only one product but some irreduc- 
ible minimum would be shared or joint costs. These 
cannot be measure d as due solely to product X, or Y. One 
does not know hov; much of these shared resources are, in 
truth, due to X or Y. If shared costs are to be charged 

to X and Y, the a^jcignment m ust be a rbitrary. There, . i s_ 

n o other way . 
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Fortunately, the economist often may avoid concern 
with this issue. His primary interest is in determining 
the optimal level of output and this depends on marainal 
cost. Marginal cost docs not depend on fixed cost. 
Hence the problem of what to do with shared fixed costs 
is avoided. 

B. Direct and Indirect Costs 

The accountant, especially the cost accountant, has 
a different problem. The information assumed known by 
the economist^ is often unavailable to him. Specifically, 
the marginal relations are unknown. This being the case, 
the accountant v/ill often work from averages . His firm 
will often desire to set price to cover unit cost, (and 
unit cost is average cost.) 

To determine the price of X and price of Y, the 
accountant must know the unit (average) cost of X and 
unit cost of Y, 

First, we will seek to determine all costs that are 
unambiguously due to product X and to product Y. These 
are termed the direct cost of X and the direct cost of Y.^ 
What remains will be indirect costs. The primary compon- 
ent of indirect costs will be fixed cost items but some 
variable costs will be included. Conversely, the primary 
component of direct costs are variable costs, but some 
fixed costs will be included. 

If the allocation of a variable resource to a given 
production process is not measured, then the associated 
cost becomes an indirect cost. Moreover, the fact that 
the major portion of indirect costs are fixed does not 
imply all fixed costs are indirect. 



1. To understand this rejall that marginal cost is the change 
in cost divided by change in output. Now total cost is 
equal to variable cost plus fixed cost. Then change in 
total cost is change in fixed cost plus change in variable 
cost. But fixed cost is constant v;ith respect to output 
by definition, so that the change in fixed cost is zero. 
Hence marginal cost is not affected by fixed cost. 

2. Economic theory works from (1) a known relation betv/een 
price and output and (2) a known relation between output 
and resource requirements and known prices of resources. 
From the latter, (2), the economist therefore proceeds 
from a known relation between output and cost. 

3. Direct costs are those costs that can be traced unambigu - 
ously to the unit being costed. Indirect costs are those 
costs for which unambiguous assignraent based on measure- 
ment is impossible either in practice or in principle. 
(Continued next page.) 
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C. Cost Proration 



While marginal cost is not influenced by fixed cost, 
unit (average) cost is. If the average cost of X and/or 
Y is to be known (and hence a price of X and/or Y 
specified) then some allocation of indirect (primarily 
fixed) costs to each product or production process must 
be made. Since the allocation cannot be made directly 
by measurement, it must be accomplished by some more 
or less sensible approximation • The accountant prorates 
fixed costs. He cannot avoid the arbitrary problem of 
proration. Notice, however, that this will always intro- 
duce an arbitrary element into the cost determination. 

Whenever possible it is best to avoid the detailed 
assignment of indirect costs through proration . The 
cost so derived may be misleading if one assumes that 
changes m the^product ' s output will change cost by th e 
computed cos tT For remember much of indirect costs are 
fixed costs and they do not change in response to output 
changesT And whenever some costs are prorated, they 
should be reported separately ::ron direct costs. 

D. Capital Costs and Proration; Depreciation 

We have referred to the problem of proration, or 
spreading, of costs in the discussion of assignment of 
indirect, or fixed v^osts. Proration occurs in another 
context also, and W3 shall now refer to that. 

Resources may be classified as to the duration of 
their economic usefulness. Some are completely consumed 
when used and must be fully replaced. Energy is illustra 
tive. Other resources provide services over many periods 
Machinery and buildings; are illustrative of these. In 
the case of resources of short persistence, their use 
and their payment v;ill coincide or nearly so. However, 
for resources which last over many periods, the periods 
of use and payment may not coincide. Since the resource 
has been paid for in a past period, current use of the 
resource seems costless. The classic case is that of 
buildings and machinery . The production of the current 
period will use only par t of the resource they embody. 
What quantity and what cost should be assigned to the 
current period? 



Footnote 3 continued from previous pages 

The analyst alv;ays has some choice as to that wiiich he 
will charge costs directly. That object will be definea 
as a nost center. It may be a product (e*g,, a custom 
Chevrolet) or a sibcomponent of a production process 
(e.g., the sales department of the Chevrolet Division). 
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Note that this problem does not occur if the capital 
resource is employed one economic entity but owned 
by some other. In th-it case the building or machinery 
is rented. The rent indicates the economic value of the 
capital resource anv. also coincides with the period of 
use . 

The problem arises when owner and user are the same. 
Tliere are several approaches to the assignment of cost 
for the period's use of this resource. All involve 
proration over time . 

The first is to shadow price^ the period's use of 
the capital resource. In this approach one does not 
price the specific resource but makes an estimate bared 
on the rents paid for similar facilities in similar uses 
under similar circumstances. Not only is this difficult 
to do but the observed units may have to be adjusted if 
the market units are distorted, as they would be under 
price controls; for example. 

Other approaches first determine the value of the 
capital resource and then spread that over the duration 
of its economic usefulness in order to arrive at a cost 
per period . Both the current value (V^) and the economic 
life expectancy (n) of the resource are not obvious and 
are themselves estimates. 

One approach relies on a depreciation rate (of which 
1/n/ where (n) is the economic life of the capital good, 
is one illustration to determine the value of capital 
consumed in the period. This is multiplied by (1 + r), 
where (r) is the highest riskless price deflated rate of 
return to capital in the economy; 2 in order to determine 
the opportunity cost of the capital used. The period 
cost (C^) assigned to the production of the period is 
then 

Ct = . (1) . (1 + r) (1) 
n 



1. A shadow price is a constructed price in contrast to an 
observable price. A shadow price will be formulated 
whenever there is no observable price or when the observ- 
able price is distorted. 

2. An interest rate is in part determined by the percent 
profit earned from investment (here in capital ) ; in part 
determined by the rato of inflation. The va].uc of (r) 
which we require has been adjusted to zero risk and zero 
price increase. 
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A second approach relies on a capital recovery factor 
expressed as^ 



r (1-fr) 



n 



(2) 



n 



(1+r) 



The period 
termed the 
as / 



cost assigned to the period's production is 
cost of capital services (CCS) and is expressed 



^t ^ (1+r)^ 



(3) 



n 



(1 + r) -1 



The two expressions are not identical but both have the 
property that the period cost increases as the rate of 
return, or productivity of capital, (r) , increases and 
decreases as the economic lifetime of the capital resource 
increases . 

This intertemporal proration is one that neither the • 
accountant nor the economist can safely ignore if the 
cost charged to the production of the period is to even 
approximately measure the costs. The point of difference 
is that the accountant is likely to ignore the rate of 
return (r) on capital and thus to understate the economic 
costs of capital and to rely on a "rule-of-thumb" approxi- 
mation, such as V^/ 1_ \ . 

^ n ' 

There is no way out of dealing with the costs of 
capital resources . It is important to remember that this 
is a proration problem, one where costs are spread over 
time instead of across activities, and that decisions 
are involved in assigning values to the economic lifetime 
of the resource {n) , the rate of return on capital (r), 
the economic value of the capital resource itself (V^) ; 
and in choosing the functional form of the proration. 



1. For discussion see Moayed-Dadkhah , Kamran and Stromsdorf er / 
Ernst; Cost Analysis of Manpower Programs: An Analysis of 
the Art ; Of f ice of Policy",^ Eva luation and Research , U • S « 
Dept. of Labor; November, 1973 ; page 6. See also Jack 
Hirshlc?if er , et al,, V/ater Supply: Economics, Technology , 
and Policy, Chicago: The University ol Chicago Press, 
1960, Chapter VII to which they refer. 
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VII: Variety of Accounts 

The variety of cost system accounts is limited only by 
the number of uses to which cost information can be assigned. 
One account system breaks costs down by the type of payment 
to different kinds of resources, or object. Such a system 
is often referred to as a line-item. Examples of the cate- 
gories of such a system are wages -^nd salaries to personnel, 
annual leave, holiday, rent, utilities, program suppliers, 
office supplies, etc. Another system allocates custs on 
the basis of functions performed — kind of action taken or 
purpose for which a thing exists or for which it is used.-"- 
By way of illustration a common function in education is 
that of instruction. Still other accounts may be based on 
operational unit, instructional organization, job classifi- 
cation and activity assignment, and others. A given cost 
system may employ one set of accounts or any combination 
of two or more. In general, the greater the number of uses 
requiring information the more numerous the dimensions of 
accounts • 



VIII: The Locus and Boundary 
of Costs (Who Pays?) 

In a cost analysis it is important to determine whose 
costs and/or expenses are to be determined. The cost boundary 
may be drawn around a unit of any size from tne individual, to 
each of the various levels of government (e.g., school district, 
...federal government), and to any combination of them, and 
finally to the society as a whole. Frequently several of these 
will be involved in a cost analysis* 

Model IV career education project is an example. The 
costs borne by the participating family will be an object of 
conca^rn to that family. If those costs are excessive (in 
relation to benefits) then cooperation will be difficult to 
attain. If the program is to be adopted elsewhere, the local 
funding agencies will be concerned v/ith the incremental 
expenses (costs and transfers) which they will incur. These 
expenses will net out any contributions from the federal 
governmen Similarly the federal government will be con - 
cerned about its costs, and~as an agent for society is 
obligated to determine the economic cost to society as well . 



1. See Financial Accounting: Classification and Standard 
Terminology lor Local and State School Systems 1973 ; 
Roberts, Cl\arior^ T and Lichtcnboryer , Allan R., U.S. 
Office of Education; (DIILU Publication No. (OE) 73-11800; 
U.S. Government Printing Office; 1973; p 22 ff. For 
some purposes it may be wise to separate these. Counseling 
(kind of action taken) may be employed for several purposes • 
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The issues of (1) NIE program research and development 
costs and (2) replication costs of service delivery involve 
precisely this issue. 

Research and development costs are those of the federal 
government; replication costs are those of the local spon- 
soring agency. The cost boundaries differ. Moreover, while 
NiE and potential adopters are more likely to be interested 
in expenses than costs, a social evaluation for efficiency 
purposes will focus on costs. 



IX: Physical Inputs and Dollar Costs 

In our early discussion, we attempted to make clear 
that when we are interested in costs, our first focus is 
upon the technological relationship that exists between 
results and physical quantities of resources. Costs are 
determined when resource prices are attached to the phys- 
ical resource units. Physical resources are the link 
between output and cost. 

In the analysis of replication costs , the adopter is 
more likely to be interested in resource requirements which 
he can price in his ov/n market and which he can adjust for 
resources already available to him than in the aggregate 
of costs, even when broken into categories, salaries, rent, 
etc. or administration, career guidance, counseling, place- 
ment, etc. Estimation of increm.ental costs of program 
adoption should be based on the physical quantities of 
required resources . 



X: Summary 

This chapter has dealt with many issues related to cost. 
Several terms have been defined: cost and expenses; oppor- 
tunity cost; fixed cost; variable cost and total costs; 
average cost and marginal cost; direct cost and indirect 
costs; acquisition costs and start-up costs; capj.tal costs. 
The relationship between these have been discussed. The 
importance of establishing the context of cost — the 
analysis of boundaries and concepts — was emphasized. This 
leads to an important conclusion. No one cost system will 
be ideal. Cost and expense collection must be based on the 
needs of users of cost information. Where many uses are 
possible, it is best to collect cost, physical resource, 
and results information in the most cjetailod (disaggregated) 
manner. Concern for cost related data collection must be an 
intccjral part of research and devclopnicnt project design at 
an early stage . 
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Chapter Three 



REPORTING OF PROGRAM RESE A RCH AND DEVELOPMENT COSTS 

This chapter addresses only the issue of reporting 
program research and development costs in standard categories. 
Treatment of this issue postpones the second issue of des- 
cription and estimation of the start-up and operational 
costs of service delivery likely to be experienced v/hen a 
program, once developed, is implemented by an adopter 
in a non-research and development setting. The two issues 
can be discussed sequentially, and the second will be 
discussed in the next chapter. Suffice it to say that the 
estimation of implementation costs of a developed program 
will be based in part on the cost records of program 
research and development. 

Formulation of a cost system requires: 

1. Clear understanding of the purposes to which infor- 
mation, once gathered, will be put. 

II. Description of the production or treatment process 

in terms of results, inputs, and stages in production 
or services. 

III. Specification of dimensions. 

IV. Specification of basis of cost and payment reporting. 

V. Design of a system for the measurement of direct 
resource requirements, costs, and expenses. 

VI. Determination of treatment of indirect resource 
requirements , costs , and expenses . 

I . Purpose of Data 

A cost system requires that those who are to receive 
information from the system be clear as to its potential 
uses. Here, the general purpose of the cost data to be 
generated is to report the costs of program research and 
development in a mianner which will permit meaningful 
comparison among contractors. Suggested categories include 
research and development, evaluation, and operations. V7e 
list these not because they are those which will be finally 
employed but because they indicate a desire to go beyond 
reporting total cost. Instead, costs are to be described 
in terms of tho fundamental function:: performed in the 
process of research and development. Such information 
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will be useful for the monitorinq and control of research 
and development costs. This purpose will be facilitated 
if the terms of budgeting planning correspond to those of 
accounting and periodic reporting. 



II. Description of the Research and 
Development Production Process 

Cost arises out of a production process. Cost information, 
other than total cost, will be most useful if structured 
in terms of that process. An understanding of the pro- 
duction process is the basis for the cost system to be 
discussed. Topics of this section include (a) definition 
of research and development activity, (b) activity output, 
(c) activity resources, and (d) processing activities. 

A. Definition of Research and Development 



There are no technical conventions which are widely 
accepted in defining the process of research and 
development. Several have grown up in application to 
the physical sciences and ail, of course, in the 
context of business accounting. Most must be 
tempered in applying them to governmenl: activities 
in the applied social sciences. 

These definitions are based on U.S. National 
Science Foundataon defiritions. They are primarily 
taken from the Price Waterhouse Review , Summer, 19 67. 

1. Research and Development. Activities and their 
costs are assigned as reseai-ch and development 
v^/hich include basic and applied research in the 
sciences (and medicine) and in engineering, and 
design and development of prototypes and 
processes. It does not include quality control, 
routine product testing, market research, sales 
promotion, sales service. 

a. Basic Research. All activities and their 
costs are classified as basic research • 
which represent organized investigation 
for the advancement of scientific knov/ledge 
and which do not have specific commercial 
objectives, although they may be in fields 
of potential interest to the firm, or funding 
agency. 



1. Hallov/ay, Frank; "Cost Accounting For Creative and 

Non-Prof 1 t Actlvitior;" ; P r i c n Via t n r h o u n c Rc v i c:v/ ; Vol.12, 
Spring 1967; pp. 24-29. Sir,u.lar definitions have been 
referred to ol.sewhioro. Sec Dorfman, Robert; fleasuriiiq 
the Ben ( '. fit-.r; of C ovcrnmc nt In vestment , Brookings 
InstituTioii; Washing ton D . C .' ; 1965 ; p. 14. 
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b. Applied Research. Activities and their 
costs arc assigned as applied research 
activities which are directed to discovery 
°^ H^i^^ scientific knowledge which have 
specific comiTiorcial objectives with respect 
to cither prc^-jcts or process, (again, with 
respect to the intent of the firm or funding 
agency. ) 

c. Development. Development activities and their 
costs _ include those projects of technical 
activity concerned with non-routine problems 
which arc encountered in translating' research 
findings and other scientifij knowledge into 
products or services. (Restated, development 
means the systematic use of scientific 
knowledge directed toward production of use- 
ful materials, devices, systems, or methods 
including design and development of prototypes 
and processes . ) 

The relationship among these three terms is shown in 
Chart I which follows. 

In this study, we shall proceed on the basis that 
it is possible to distinguish applied research from 
development only if research is the sole R&D 
activity. If development is undertaken, some new 
knowledge can always be reported so that applied 
research is always involved. The distinction between 
newness of scientific knowledge and application of 
knowledge is more difficult to perceive than that 
between coitimercial objectives and non-commercial 
objectives. Therefore for purposes of study of 
CEDTF, we shall distinguish two categories (1) Basic 
Research and (2) Development and Applied Research. ^ 
The latter, we believe, defines the major portion of 
project work in education. 

^ ' Activity OutpuL 

The output of research and development in educa- 
tion may be either a set of materials which describe 
the manner in which some process is to be established 



1. Alternately, Research may be separated from develop- 
ment on the basis of an experimental design in the 
evaluation of the effects of the program upon the 
student population. 
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CHART I 



Relationships Distinguishing Basic and Applied 
Research and Development from One Another 



Production of 
New Knowledge 



Basic Research 



- Not Directed Toward 
Specific Coiimiercial 
Objectives 



Applied Research 



Application 
of Knowledge 



Development 



Directed Toward 
Specific Commercial^ 
Objectives 



and operated (a new educational production process) 
or a concrete product in the more tangible sense of 
physical items to be directly applied. In the former 
case, research and develonment has produced a new 
technology, itself intangible, the concrete mani-- 
festation of which is a set of handbook materials 
describing procedures for its installation and 
operation. The primary product is that result of 
research and development which encompases most 
effort and which is a prerequisite to other products. 

If output is at all complex, the primary product 
may be broken dovm into subproducts. For example 
when the product is an entire educational system, 
as it is in the case of career education research 
and development projects, the sub-products may be 
various elements such as governance, management, 
experience site recruitment , special learning 
materials, or staff training procedures. 



1. --Tliis term shall be understood as having the broad 
meaning of saleability, or having the capacity of 
satisfying a presently felt public or private need 
or want at an affordable price and cost. 
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These Pubproducts frequently correspond to what^ 
at present and for budgetary purposes; are termed 
work units. It will therefore be useful to report 
costs in terms of subproducts , whenever possible. 
By so doincj/ the accounting system provides an 
expense record which conforms to the budgetary 
format. 

In addition to the primary product and its 
subproductS/ the research and development contractor 
may be responsible for additional related products. 
Cost/effectiveness studies, benefit/cost analysis, 
and experimental research as to the effects of the 
primary product are illustrative. We define these 
as secondary products. 

Definition of subproduct and secondary products 
depends ypon the specific research and development 
project."^ To illustrate, we will choose subproducts 
and secondary products derived from the Experience 
Rased Career Education (EBCE) research and develop- 
ment project at Northwest Regional Educational 
Laboratory (NWREL) . Subproducts defined by that 
laboratory include : 



EBCE Subproducts 



1. 


Governance 


2. 


Management 


3. 


Ins+Tuctional System 


4, 


Basic Skills 


5. 


Life Skills 


6 . 


Career Development 


7. 


Guidance 


8. 


Employer Community Utilization 


9. 


Logistics-Student Support Service 



Taken together these products are illustrative of the 
subproducts of EBCE research and development output. 
Secondary products include cost studies and exper- 
imentally designed research. 



r. In cases where several contractors are developing 
the same product, the same subproduct categories 
should be defined in so far as possible. 
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C. Activity Inputs 



The inputs to the research and development 
proccf^s arc the hiiraan and nonhuman resources required 
to produce the primary product, subproducts and 
secondary products just discussed. It is important 
to recall that ctudentc and clients are one of these 
inputs as well as being an output of the production 
process often under development. In money terms, 
these resources give rise to costs. Inputs include 
noncost money payments, or transfers, as well. 
These expenses are recorded in the line item object 
cost record. 

D . Standard Categories to Describe Research and 
Developmen t 

A production process consists of a number of 
distinct activities. Formulating a cost system 
requires that such activities be defined. Ideally, 
the elements of such a set of operations should be: 

(1) Complete, or exhaustive, 

(2) Mutually exclusive, and 

(3) Limited in number. 

In hum.an services, no set will be fully approved 
by all persons concerned. We shall specify a set 
of activities based on our association with research 
and development activity in career education. We 
offer these as Standard Cost Categories. In doing 
so we fully recognize that such a list of activities 
and their definitions is provisional and would 
have to be continually modified by experience during 
development of a cost system. 

Research and development commences with an 
agreement between a sponsoring or funding agency 
(The Fundor) and a research and development unit 
(The Contractor) . These may or may not be separate 
organizationally. 

Once work has been assigned to the contractor 
there is a period of time during which the tv;o 
agencies come to final agreement as to specifications 
of the work. In applied research and development 
this will include agreement upon the exact character 
of the product, (e.g., provide career guidance 
counf;el.inq u:;inq para-prof ess i cnals through telephone 
sessions) . This the first instance of an activity 
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which we term Fundor Negotiation and Liaison. During 
and following this period staff are recruited, hired , 
oriented and trained . This is a second activity. 

The next task will be to specify the elements of 
structure and process and their properties necessary 
to the final product. Perforitiance standards for 
these must be specified. Finally, the elements sc 
specified will need to be fabricated. We categorize 
these activities as Product Design activity. 

The designed elements will be tested as to 
efficiency. The first step in testing is to "try 
out" or apply that which has been designed. We 
define this activity to be Product Application. In 
order to apply the product or its elements, a site 
must be available. Obtaining and maintaining such 
a site requires another activity. Site Negotiation 
and Liaison. Performance of the product when applied 
at the site must be recorded; this v/e call the 
activity of Documentation. One use of the information 
so derived is to provide a basis for comparing the 
performance of the product with its design objectives. 
This activity, which also includes specification of 
data requirements, provision of the instruments for 
data recording for comparative purposes, as well 
as conduct of comparison and analysis, we call 
Product Evaluation. The activities of design, 
application, documentation, and evaluation form a 
continuous recurring process which proceeds until 
evaluation shows that performance satisfactorily 
approximates design specifications. 

When performance is satisfactory, the final 
product is prepared. This activity will consist, 
as stated above, of preparation of a set of materials 
which describe the manner of installation and opera- 
tion of the developed process or production of the 
proven product. This activity we' call Product 
Finishing. Product finishing also makes use of 
information gained and recorded in the documentation 
process . 

In some circumstances, the contractor performing 
research and development will also perform services 
directed tov/ard the promotion of adoption of the 
developed product by potential users. In so doing, 
the developer may provide general information to the 
public, contact specific potential adopting institu- 
tions, and provide technical assistance in installation 
and initial operation by such institutions. This 
operation wo call that of Product Diffusion, or 
replication. 
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CHART II 

Research and Development Activities 



r" 



Product Testing 




4- 



PnductCs ) 
Appl ica tion 



Documcn ta- 
t i on 



Product 
Repl icatit)n 



<— 



Prod'jc t ( s ) 
Finishing 



r 



Product(s) 
Evaluation 



no 



± 



1 



f under 
(Sponsor) 
Ncgotia tior 



Staff 
Recru i tmenl 
fliring 
T >^ a i n 1 n g 



Site 

Negotia tion 
& Liaison 



General 
Administra 
tion & 
Liaison 



Finally^ there will be activities not associated 
with any of the operations we have just discussed. 
We call it General Administration Housekeeping and 
Clerical. 

Chart II displays the relationship and activities 
described above. 

Specific activity definitions are given below. 
Activity 1. Product Design ; 

Product decign encompasses all activity asso- 
ciated v;ith the conception/ planning, fabrication. 
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and pGrformanco specification of materials, 
processes , techniques , institutional arrangements 
and structures, methodology, and approaclies 
which arc required either for trie conduct of 
a research endeavor, supposing that to be the 
totality of the effort, or for the rendering of 
innovative and tentative educational services, 
supposing researcli is to be augmented by 
development. Illustrative activities from career 
education include but are not exhausted by the 
design of a particular career education approach 
in toto; design and fabrication of curriculum 
and resource materials, of student guidance 
procedures, of employer recruitment procedures, 
of telephone counseling techniques , of information 
systems, of employer site analysis procedures, 
of student recruitment techniques, of logistical 
arrangements (insurance, transportation, etc,) • 

Activity 2 . Product Application ; 

All activity associated with the realization 
through use — that is implementation — of the re- 
sults of design activity is defined as product 
application, ^ 

Illustrative career education activities 
include application of curriculum materials, 
student recruitment processes, guidance proced- 
ures, and counseling in the delivery of services 
to the studcnt-client-participant ; the payment 
for provision of logistical services once 
formulated and arranged; the implementation of 
information systems for recording and collecting 
information. 

Activity 3. Product Evaluation : 

All activities associated with devising means 
for the measurement and assessm.ent of program 
performance relative to design standards of 
products as applied in Activity 2 above are 
considered product evaluation. 

Activity 4, Product Finishing ; 

Product finishing includes activity associated 
with the fabrication of the end product of 
development in a form v;hich is to be deliverd 
to the funding agency, once acceptable performance 
har; bccm validatjul by evaluation. Illu5Jtrative 
career education activities include writing and 
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production of do ruments which describe the 
curriculum, and teaching procedures in order to 
accomplish basic education or documents which 
describe the materials and methods of telephone 
counneling in career education. 

Activity 5. Documentati on : 

Documentation includes all activity asso- 
ciated with the collection, organization, and 
storage of information for purposes of reporting, 
dissemination, and final product production. 

Activity 6, Diffusion ; 

All activity associated with the introduction 
of the research and development program to 
general users for consideration ind adoption 
is replication acr.ivity. The following are 
illustrative : preparation of materials 
acquaintinr the general public or the general 
educational community with the broad character, 
goals , and accomplishments of career education ; 
discussions with specific groups to encourage 
and facilitate adoption of career education; 
and renderJ.ng assistance to those who have 
adopted or are adopting career education programs. 

Activity ?• Fu ndor Negotiations and Liaison : 

Fundor negotiation and liaison encompasses 
all activity associated with negotiation and 
liaison with the project funding agency due to: 
specification of operation plans, mutual agree- 
ment as to the terms of characterization and 
performance of research and development activity 
with requirements imposed by f undor-approved 
subcontractor requirements , and contract re- 
newal. This activity includes assisting fundor 
contractors in performing their tasks • 

Activity 8. Site Negotiations and Liaison : 

All activity associated with securing and 
maintaining the permission and support of 
jurisdictional authorities for conduct of the 
research and development work in the area of 
their authority constitutes site negotiation 
and liaison. Meetings with state departments 
and local boards of education to elicit their 
support, and investigations into legal requirements 
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for installation of career education are 
illustrative , as is continuing public relations. 

Activity 9, vStaff Roc ruitniont and Training : 

All activity associatr-id with the recruit- 
ment, hiring and orientation of staff is staff 
recruitment and training activity • 

Activity 10 • General Administration, Housekeeping 

and Clerical : 

All activities of a managerial, supervisory, 
janitorial, and/or clerical nature not specifically 
identifiable to any of the above is subsumed 
under general administration, housekeeping and 
clerical activity. 

Costs of these ten activities will not account 
for all payments by the f under to the contractor. 
Contractor indirect activity and expense plus fee 
must be included . 

Again, it should be noted that the above activ- 
ities are not based on an attempt to distinguish 
research and development activity from operations 
activity, where operations is usually meant to be 
the cost an adopter will experience if the devel- 
oped product were adopted. It is our position 
that both research and development and operationj 
entail many of the same activities, specifically 
Design, Application, Evaluation, Staff Recruitruent 
and Training, and General Administration and Clerical. 
Research and development differs from operations on 
the basis of the absolute and relative emphasis 
given to each of 'he activities just mentioned. 
We are not neglecting but rather deferring the issue 
of cost estimation of adopter service delivery costs 
until the follov;ing chapter. 

One description of research and development 
asserts that several activities are ongoing at the 
same time and thereby not distinguishable from one 
another. We agree that this is true for the enter- 
prise as a v;hole. However, our judgement focuses 
on the individual staff member. We believe that 
any single person can state the purpose of his action 
at any given moment in terms of the one of the ten 
catcrfories listed above. It must be admitted that 
modification will take place should such a categori- 
zation 5jyi;Lrjm be instituted. 
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III. Specification of Dimensions 



In any cost roportinq system, dimcMisions for cost 
reporting must be specified. For example, throe possible 
dimensions have been mentioned. In the previous section, 
WG discussed resources, activities, and products and 
subpioducts. To each of these correspond a dimension 
for cost accounting and reporting as follows: 

(1) Resource, or Cost By Object; 

(2) Activities, or Cost By Function; 

(3) Cost By Product and Other Tasks. 

Two dimensions, cost by activity and cost by product 
should be employed as a means to report costs of research 
and development. In the previous section, we defined 
ten activities as Standard Cost Categories. These 
are to be uniform for all research and development 
projects. The primary product, subproducts, and second- 
ary products depend on the particular project and will 
need to be defined in relation to it. In the previous 
discussion, a listing of subproducts and secondary 
prodnntc was illustrated. (See pages 29 and 30.) 

Chart II displays the combined dimensions of product 
and of research and development activity in the form of 
a possible report. The cost information of such a 
report can easily be related to project budget tasks 
and milestones. 

The chart categorizes activities into those which 
are direct to activities and products and those which 
are not. Direct activities are those for which payments 
and resources and their cost < an be traced to individ- 
ual coinbinations of activity, subproduri-s and secondary 
products. Indirect activities are those for which re- 
sources, costs, and payments generally cannot be traced 
to a specific combination as described above- 

In some cases, activity of one kind can be directly 
traced to some subproducts but not to others. V7e have 
included these as direct activities • For example. Appli- 
cation is included as a direct activity because in many 
cases it can be traced to a specific subproduct even 
though Cor some (e.g., basic skills, life skills, career 
development^) separation may not be possible. But 



1. This is our judgment at this time* Whether or not 
application acclivity relative to th(\se three sub- 
products can bo reported separately v;ill be determined 
by experience should such a procedure be instituted. 
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application is treatocl as a dircv. activity since such 
activity can be traced to most subproducts. 

In the loft hand marqin, the subproducts of research 
and dovolopmont aro listed. Lino 30 ciives the total 
allocation of costs to each direct activity. Provision 
is also made for secondary products. These are results 
of activity which cannot be properly understood as 
component parts of the object under development. Such 
secondary products would include any of various cost 
studies of the primary R&D product • Any given row 
records the cost due to a particular subproduct or 
secondary product. The cost by activity for that product 
is found by reading across the row from left to right. 
Appropriate totals for all activities are also entered. 
The grand total entry (line 38) presents the totals for 
each column and of project expense. 

CoDumn entries show for each activity the distribution 
of activity cost to each subproduct and secondary product, 
where appropriate. Some columns make provision for 
cost totcils of activity groupings and for indirect costs. 
The grand total column (column 20) displays the distribu- 
tion of all costs for each subproduct, secondary product, 
and their total. The remaining columns provide cumulated 
and budget cost comparisons. 

The third dimension, cost by object, need not be used 
for purposes of reporting research and development costs. 
However, concern with resource requirements and payments 
will enter into the discussion of replication cost 
estimation in the following chapter. 



IV. Method of Accounting 

The timing of realized income receipt and cost payment 
of the contracto r v/ill differ from the timing of assign- 
ment of unqualified rights to receive income and of 
clear obli rfation t o make Payments. Recording on the 
bo :;is of actual income and expense payments is cash 
basis accounting , Ivocording on the basis of right to 
receive, and obligation to make , payment is accrual 
accounting. Accrual accounting does not require that 
no account be kept on a cash basis. It only requires that 
ail substantial accounts be kept on the basis of accrua], , 

The timing of the allocation of resources in actual 
performance of services rendered and received more closely 
coincides with the right to receive and obligation to 
make payment than with actual payment. Actual payments 
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my bo dn for rod cind co ncen trate d in q parti cular peri od, 

Thorcf oro , ?1^^.9J££!J:> of oonbh^ b ascKl on ca .sh J.lo\v^s ma y 

present a di5v ^orted picture or sor vicos perform e d Imd 

rosourcen coninmuKl . 1^ c ) r b 1 1 a t ^o^^J^^^ , ^^*Lccr u al a ccou nting 

is };rc?f orr> 'vi l.u :Msh accoun L.i.nc[ , K epoi' t.i nc| by' con- 
tractors, tlierefore, should be on an" accruaT basis. 



V: Direct Reporting of Resource 
Allocations and Expense 

In so far as possible, costs and other payments should 
be traced directly to the combinations of product and 
activity illustrated in Chart II, e.g., design of career 
guidance. In the context of this discussion, direct 
refers to resources and cost which can be unambiguously 
traced to specific combinations of product and activity. 

A. Personnel Resources and Costs 

In Chart III personnel expenditures account for 
58% of all costs and 70% of all contract direct 
costs. This i^i in line v/ith most service enterprises. 
Consequently, accurate assignment of personnel 
activity is the keystone of accurate assignment of 
total research and development costs. This is 
even more evident when one realizes that the most 
^PP^op^icito apportionment of indirect costs, should 
a pportionment be made; v/ill be based on staff time 
or compensation . 

Securing staff time reports in a service enter- 
prise is difficult. Professional staff often resist 
time reporting. Time reporting is difficult because 
staff perform a variety of functions and their 
v;ork efforts are not neatly circumscribed by a 
conventional work day. 

Some enterprises have settled into routine opera- 
tions or have no need to trace resources and costs 
to the client, patient, or student giving rise to 
them. In such enterprises allocation of staff time 



1. 5ec, for example. Financial Accounting ; Classifications 
and Standard To r m i nolo g y for State and Lo c a 1 S c ho o 1 
Systomn , 1973; Rob e r t s , C ha r 1 o s T . a nd Lichtenburger , 
Allon ; DIIEW No (OK) 7 3- 1 18 00 ; U.S. Government 
Printing Office; Washington D.C.; 1973, p. 2. 
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CHART III 

Typical Object Costs and Percent of Budgets 



Account Percent of Budget 

Compensation for Personnel 

and Consultants 58% 
Travel/Transportation 

of Persons 03+% 

Transportation of Things 01-% 

Rent and Utilities 05% 

Telephone 03% 

Printing* and Reproduction 01% 

Supplies/Materials 02% 

Equipment Purchase and Rental 01% 

Other Services 09% 

Indirect * 16% 

99%** 



* This is itself largely composed of costs due to 
contractor, administrative and support staff. 

** Does not add to 100% due to rounding 



36 



to activities can be described by sampling the 
allocation of their time to activities. However, 
in other enterprises, one or both of the two 
conditions mentioned above do not apply. In these 
inj^ititut ioni3 , r;amplincj is not a substitute for 
accurate time reporting. 

This is precisely the case for developmental 
projects. There is need to ascribe resource allo- 
cation and cost to particular functions and processes. 
Secondly the program processes are not routine. 
Thus, it should be understood that detailed time 
reporting is essential to NIE research and develop- 
ment projects. 

If time reporting is to be undertaken, the system 
must account for the problems mentioned above - the 
multiactivity nature of j ob performance and the 
variability of time and length of work hours. In 
addition, the reporting process nust foster accuracy. 
Accuracy will be promoted to -.he degree that re - 
porting is contemporaneous with activity and to the 
degree that the forms for report require minimal 
staff effort. To take account of these requirements, 
the following criteria must be met: 

1. Actual hours devoted to work should be 
reported. 

2. Reporting should take place contemporaneously 
with performance of duties . 

3. Reporting format should minimize staff effort. 

1. Staff Should Report Actual Hours Worked 

The time reporting system should request staff 
to report the actual hours v/orked. Reports 
should include time allocated instead of, or 
in addition to, the regular work day irrespec- 
tive of where work takes place. 

As a consequence of the above , the cost of 
staff effort will be assigned on the basi of 
an ef f ect.lve rate of individual compensation . 
Individual compensation is defined to include 
all payments made as a direct consequence of 
individual employment. Compensation includes 
salary, money value of accrued vacation and 
sick leave , employer * s contribution - on the 
behalf of the individual - to social security 
or any other staff benefit programs. Not included 
are payments which are dun to all employees 
as a group and which do not change in response 
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to a cjivcn individual. These arc fixed costs 
and are proporly considered as indirect costs. 

Total compensation must be converted into 
componr^a t j on jxn* i^ay (or roporting) per iod or 
compensation per workincj day. If compensation 
per day is calculated, then the value of com- 
pensation per pay period is determined by multi- 
plying the value of compensation per day by the 
number of working days in the pay period. For 
the ith individual and the t^h period, let this 
be CM^^. 

The number of hours allocated to productive 
effort during the period will have been reported. 
Let this be Period compensation is divided 

by period hours actually worked. The result is 
the effective rate of individual compensation. 
Call this w^^. That is, 

Wit = (CMit/L^^). 

This value will differ between individuals and 
among pay periods for the same individual. 

Assignment of working hours to each of 
several combinations of product and activity 
is derived from staff reports. Let the time 
assignment by the ith individual to the j th 
activity and k^^^ product be L*.. . Assignment 
of cost, (Cl^., )*, of individual direct allo- 
cation to eatin combination is the product of 
hours allocated multiplied by the effective 
rate of individual compensation. That is, 

This method of allocation for staff services 
is an alternative to one based on a conventional 
number of hours per pay period. If a conven- 
tional number of hours is established , the 
computations arc? less numerous and therefore 
easier , but .qtaf f are forced to report their 
time in a manner that docs not fit their actual 
allocation of time . Moreover, to the extent 
that allocation to the sjeveral activity-product 
categories docs not take place randomly with 
respect to reportable and nonroportable hours , 
the cost record will g j.ve dispropor tionate 
weigh t to those act i vi ties which are concen- 
trated in the normal working period of the day. 
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2. Staff Should Report Contemporaneously With Activity 



The freciucncy with which staff -will report 
time depends in part on the degree of variation 
■ in thc^ tasks to which thoy allocate their tine. 
Reporting frequency also depends on the degree 
of detail required in reporting^ since that 
detail is in part a determinant of the variety 
of staff task assignment • Finally , frequency 
depends on the variation in working hours of 
the same individual. VJhere the level of detail 
is not great, where staff time allocations do 
*not vary, and where working hours are constant, 
recording on an infrequent basis is acceptable. 

As we have stated above, however, development 
project sr.aff perform several tasks over the 
period and working hours vary. The system con- 
tains significant detail. Infrequent reporting 
v/ill lead to errors in cost assignment depending 
on the accuracy with v;hich staff recall time 
allocations and task assignments . If the errors 
are random, total hours will be incorrectly 
reported but costs will not . Only the effective 
wage will be affected* However^ it is unlikely 
that err;ors will be random. Error for a given 
event v;ill be due to memory error, and that 
varies v/ith respect to proximity to point of 
recall, relative magn.i tude , routineness , and 
importance to the reporting staff member . 

Reducing memory error is important, and 
therefore staff should report their time as it 
is allocated among several tasks. This require- 
ment usually will not be perfectly fulfilled 
in actual practice . That fact only reinforces 
the need for forms and procedures v;hich 
encourage contemporaneous reporting to the 
greatest possible degree. Activity reports 
should be submitted daily. 

3. Reporting Format Should Minimi5?:e Staff Effort - 
A Sample Report Form 

EBCE students at NWREL must keep time records. 
The form used also suggests itself for staff 
use. The form used also suggests itself for 
staf^ use. The form is described in Chart IV 
on the following page. 
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CHART IV 



Staff Time Report Form 


January 28, 1974 


Activity 


■L JL W <X ^ W 


7 : 00 






7 : 15 






7:30 






7:45 






8:00 






^ : 15 






R • n \/ i Q 1 A "1 rrs Prirrrrr 


A 1 T <^ 4" '1 




8:43 




KC SOUiTC e 


0*00 






9: 15 






9:30 






9:45 






10:00 






10 : 15 






l0:30 ni^^rn^^ FRPP 




i "f" 1 on 

L Cl L* ^ i 1 


10:45 v^if h Al^ TPS 


r^nrl Ti"ir^ic;nn 

Cl 1 1 Vv4 XJ A. a A. tD\y I L 




11:00 






11:15 






11:30 






11:45 






12 : 00 






12:15 






12:30 






12 : 45 







1:00 






]. : 1 5 






1:30 






1:45 






2:00 






2:15 






2; 30 






2:45 






3:00 






3 : 1 5 






3 : 30 






3:45 






4 : 00 






4 : 1 5 






4 : 3 0 






4:45 






c o 11 1 i. 11 u o on b<i c k . 
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The form can be produced in monthly books 
with finished reports submitted daily • This 
particulcir form is suggestive only. 

Direct Nonpernonnel l^.osources and Cost 

Nonpersonnel resources and associated costs 
and payments account for A2% of all cOots and 30"^^ of 
all costs directly traceable to a specific research 
and development project. Every effort should be 
made to trace these costs, especially va riable costs, 
directly to the combinations of product^and activity 
giving rise to them. Denote these by I^^ji^t* 

Common procedures should be used by contractors. 
Some part of travel/transportation of person, 
telephone (primarily long distance) , and other 
services will lend themselves to direct-reporting. 
The means for capturing direct cost data requires 
that a statement of purpose of mterial be recorded 
on purchase and work orders and that a record of 
long distance phone calls be kept which retains the 
same information , 

The remaining costs are indirect. These will 
fall into two categories. First are those which 
cannot be traced directly to one of the product- 
activity entries in Chart II but which can be 
traced directly to the project. The second includes 
costs which can not be traced to either the entries 
of Chart II or to the project; these are clalled 
Project Indirect Costs , 



VI. Treatment of Indirect Costs 

Two categories of indirect costs have just been 
mentioned. One contains those indirect costs traceable 
neither to product- activity categories not to the 
project itself. We call these Project Indirect Costs, 

Project Indirect Costs come from several sources. 
These often would be included: 

A, Costs due to supervision and management above 
the project level, 

B, Occupancy Costs - building facilities and utilities 
plus related expenses, 

C, Costs of payroll and personnel functions, 

D, Costs of technical support personnel. 
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Treatment of occupancy cost is most likely to vary 
among different contractoi's . Some make a direct charge 
to the project based on space utili-^ed; others do not 
and include such charges in project indirect costs. 
'Vho. former practice is more informative . 1 Those occu- 
pancy costs which are directly traceable to use. of 
facilities by the project should be assigned to it. The 
remaining occupancy resources and costs assigned to 
nonproject staff remain in the project indirect category. 

An important issue with respect to indirect cost 
is the question of proration. Where costs must be 
recovered, proration is necessary. That is why project 
indirect costs are prorated to the project. However, 
where the purpose of cost information is other than cost 
recovery, little purpose is served by prorating costs. 
Doing so may actually be misleading, since direct and 
indirect costs tend to respond differently to changes in 
the project. Therefore project indirect costs should 
not be prorated among the several direct categories. 
Subject to removal of occupancy costs, a simple state- 
ment is sufficient. 

The remaining category of indirect costs includes 
those assigned directly to the project but which cannot 
be traced directly to the program-activity entries of 
Chart II. The usual method of handling such costs is 
to define cost pools for the collection of indirect 
costs at different levels. We shall define them as 
activity indirect, product indirect, and staff indirect 
resources and costs. 

Then the costs so accumulated may be prorated from 
the several cost centers to the appropriate cost pool. 
But again, why should costs be prorated at all? No 
purpose is served. Therefore, indirect costs should 
simply be reported in total. 

The urge to prorate indirect cost, however, is very 
stron g. If costs must be ororated, th en the approp riate 
cost ppol and proratTon formulas must be defined . 

For example, one important cost pool is the individ- 
ual staff member. Costs of facility, utilities, local 
phone, and office supplies can be traced to the individual. 



1. However, it should be emphasized that proration, 
generally based on personnel time allocation to 
activities, is involved. Therefore, assignment of 
such cof;ts sliould be specified in the reporting 
structure . 
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Then *:ho cost: of those items can bo prorated on the basis 
of his time allocation to product-activity categories. 

Such cost pools and apportionment formulas are 
alv;ays arbitrary; hownvor. Indirect cost v;ill be a 
combination of variable and fixed costs, i Due to this 
it will be difficult to draw on experiences about the 
effect of chancres in the project on indirect costs. To 
the degree indirect costs are intertwined with direct 
costs, the ambiguity with respect to effect on cost of 
project changes is extended to total costs. If indirect 
costs are to be prorated, the reporting format should 
separate direct costs and prorated indirect costs before 
giving total cost. The method of apportionment should 
also be clearly stated. 

In conclusion, facility cost and utilities should be 
separated from project indirect costs. Indirect costs 
should not be prorated but simply reported in two cate- 
gories, indirect costs a:nd project indirect costs. If 
prorated, however, direct and indirect cost assignments 
should be reported separately. 



VII. Summary 

This chapter has described a framework for a system 
which provides uniform reporting of research and develop- 
ment costs. The system stresses products and subproducts 
and research and development activities. It is harmoiiious 
with budgetary-planning procedures. 

The standard activities are ten in umber, and we 
believe they encompass the work of any research and 
development project in the applied social sciences. 
These activities do not divide costs into research, 
development, operations and evaluation. Instead Design, 
Application, Evaluation, and Product Finishing are taken 
to be the activities that describe research, development, 
or operational efforts. Also no distinction is madd 
between summative and formative evaluation. Six 
addition^il activities - Documentation, Fundor Negotiation 
and Liaison, Site Negotiation and Liaison, Diffusion, 
Staff Recruitment and Training, and General Management, 
Housekeeping, and Clerical - have been added. To not 
add these activities would be to leave substantial areas 
of activity uncovered. These ten standard activities 
define the first dimension of the cost system* 



1. See Chapter Two, page 10. 
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A second dir.ionsion is that composed of products and 
subproducts of tho project. These of course will vary 
from project to project as they are shaped by the nature 
of the particular project. However^ there should be 
similarity of proLluct and snl)product catogorios among 
contractors charged v/ith developing similiar programs. 

The dominant cost in such projects is personnel costs. 
Characteristics of a time accounting system were suggested. 
Sampling was not used since staff activities arc not 
routine. Staff time reporting is to be in terms of 
actual hours allocated to services . Cost is assigned 
through the mechanism of an effective rate of compensation. 
Staff are also to report the allocation of their time 
contemporaneously v;ith their work effort. V/e believe 
that after staff have gained experience with this system 
and it is modified to take account of that experience, 
they will find it easy to work with. Firsts it is 
divorced from reporting for the purpose of pay. Second^ 
it records the allocation of time in the terms by which 
it is allocated in actuality; Reporting is not impressed 
into a mold of the standard work day convention. 

We have recommended that every effort be made to 
trace nonpersonnel costs directly to product-activity 
categories. However^ substantial indirect costs remain. 
These fall into tv/o categories. One contains all costs 
directly assigned to the project by the contractor but 
which cannot be so assigned to activities v/ithin it. 
The second contains costs not directly charged to the 
project. This second category often contains costs for 
space and the associated utilities provided by the contrac- 
tor. V7e recommend that these be removed from this 
category of indirect costs and that^ where possible^ 
they be directly charged to the project. 

It is possible to prorate indirect costs across 
product-activity categories. Vie believe that no purpose 
is served by so doing when reporting development costs 
and that indirect costs should simply be reported . 
Should proration take p.lace^ indirect costs should be 
reported separately from direct costs. 

In closing we look ahead. The next chapter considers 
the issue of service delivery cost in a nondevelopmen t 
setting. There it will be the case that resource re- 
quirements in physical dimensions will play a greater 
role. In that endeavor^ the kinds of proration herein 
made v/ill often have a loss productive role. 
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Chapter Four 



E3TIMA TT0N OF AOOPTER COSTS OF SERVICE DELIVERY 

The discussion of cost recording and reporting for 
purposes of describing research and development programs 
included neither an activity termed research and/or 
development nor one- termed operations. This was no 
oversight. It was intentional, a consequence of our 
belief that many activities present during research and 
development are also present operationally, although at 
different absolute and relative levels. In this concep- 
tion, operations are embedded in the structure of research 
and development in such a manner that operations cannot 
be considered as distinct and separate from research and 
developm.ent • 

Yet development results in a more or less proven 
product or process. The expectation is that general 
adopters will adopt and use it in applied situations. 
Such an institution we define as an adopter > 

An adopter will require answers to questions concern- 
ing the costs of service delivery. These service delivery 
costs depend on many factors. We list five of these in 
Chart A. 

Cost estimates differ with respect to the number of 
such factors which may vary in the estimate. We shall 
discuss two kinds of estimation. 

CHART A 
Cost Factors 

A. Service configuration - The particular services and 

their level of activity in 
the program as adapted by 
the adopter. 

B. VJage and price level in the adopter market. 

C. Presence of subsidies to the adopter. 

D. Sunk Resources - Resources presently underutilized 

by the adopter and therefore 
available at no additional cash 
expense to the adopter. 

E. Level of activity - Number of students or clients. 
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First, at an exploratory stage, the potential adopter 
will desire a rough estimate of cost in order to decide 
whether or not to continue exploration. Such a figure 
should be providud by the agency distributing the 
developed product. v;e shall call this estimate the 
exploratory cost estimate . 

An estimate will be made for each of the acquisition 
costs and of the operational costs. Acquisition costs 
are those which will be incurred in developing the 
capacity to provide educational services, Ac-juisition 
of required materials, staff, and skills are included. 
Operational cosiis are those that are incurred in the 
process of providing services . Acquisition costs are 
a one time fixed cost, and are independent of time period. 
For example , acquisition costs are stated as $200.00. 
Operational costs are repetitive, a combination of fixed, 
semi-fixed, and variable costs. They are not independent 
of time period and are expressed as a rate of flow. 
Operational costs, for example, are stated as $200,000 
per year or $1,110 per day . 

The exploratory estimate need not be detailed. 
Little or no effort should be required to produce it on 
the part of the adopter. A range of expected cost 
e::pressed in terms of an upper and lower limit will suffice. 
The values of these estimates will depend on the five fac- 
tors lir ted in Chart I. This cost estimate may take the 
form of the follov/ing statement. 

"We estimate that your cost will be between $X and $Y 
per month (or per year) to operate the program for Z 
students, and between $M and $N to acquire the capacity 
to serve them, " 

The provision of estimate in total terms rather than 

cost per ntudont i s aeliberate . There i s no reason to 

believe that avorftge costs would be constant at changed 
levels oi output .-^ 

If the adopter decides to continue beyond initial 
exploration to serious consideration, then cost estimates 
must be refined, hu estimate of program cost in the 
adopter's specific setting is required. Cost factors 
in addition to level of activity must be taken into account. 
Specifically, local wages and prices, and resources avail- 
able without cost to the adopter must be considered. We 
shall call this- estimate the incremental^ cost of adoption. 



1, See Chart IV, Chapter Two, 

2, The reader is referred to Chapter Two, page 13. 
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The estimates to be made involve three levels of 
complexity. Those are related to the level and service 
configuration of program activity, two of the five cost 
factors listed in Chart I. 

Level A 

What are the resource requirements and costs required 
to operate the program in the same component service con- 
figuration and at the same level of operations experienced 
at the measurement (usually the development or field test) 
site? This level provides cost estimates for only one 
value of service activity (e.g., number of students) and 
only one configuration of service. It is less an esti- 
mate and more a description. 

Level B 

What are the resources and associated costs required 
to operate the program in the same component service 
configuration experienced at the measurement site but at 
several alternative operating levels? This level provides 
estimates for different values of service activity, all 
with the same configuration of service. 

Level C 

What are the resource requirements and costs required 
to operate the program, in alternative component service 
configurations for each of several alternative operating 
levels? This level provides estimates for different 
service configurations for each given value of service 
activity. 

There are three major difficulties which arise when 
these issues are investigated on the unadjusted basis of 
cost records derived for accounting of research and 
development activity and cost. The difficulties are: 

1. Resource prices for staff employed in the same 
job positions are likely to be different — 
probably higher in a research and development 
than an operational setting . This is due to 
the higher qualifications and reduced job 
security dssociatod with lesearch and develop- 
ment employment. This can be remedied by 
estimating physical resource requirements 
and then applying resource prices appropriate 
to an adopter setting. 
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2. Operations differs from research and development 
on the basis of the relative weight of activity 
and cost in each of several categories rather 
than the qualitivc nature of the categories 
themselves. That is, design and evaluation in 
addition to application are activities found at 
operational as well as research and development 
sites. What differentiates the two is that the 
emphasis on design and evaluation relative to 
application is diminished in an operational com- 
pared to a research and development setting. 
This problem can be met by extracting purely 
developmental activities insofar as possible 
and by measuring at periods best approximating 
operational conditions • 

3, The accounting systems of adopters are likely to 
differ from those of research and development 
agencies . This is especially true if the research 
and development contractor is a profit making 
entity. The particular case which is most pre- 
valent is that of costing the use of capital 
resources — buildings and equipment. Contractors 
frequently consider this item as a cost while 
school districts tend to exclude presently 
existing facilities. Reconciling those differ- 
ences can be accomplished by again specifying 
physical, nonmonetary requirements first and 

then translating those requirements into dollar 
values . 

In approaching the estimation of program delivery costs, 
the central feature is to begin not with costs but with 
specification of quantity resource requirements.-^ Cost, 
the expression of resources in dollar terms, follows. At 
the point of costing, prices and wages are applied based 
either on averages of adopter prices and v/ages in the 
case of the exploratory estimate or on individual adopter 
market prices and wages in the case of the incremental 
estimate. Also, those resources not requiring additional 
cash expenditures on the part of the specific adopter are 
excluded in formulating the incremental estimate. 



1. This is due to a suggestion by Haggert in which physical 
unj.ts of resources and completeness of resource listings 
are emphasized. See Haggert, Sue A.; Prog -am Cost 
Analyr. 1f> in Kducationa] Planning ; Rand Corporation, 
Santa Monies , Call i'ornia ; Decenibcjr 19 71 . 
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To formulate estimates, therefore, at least the following 
information must be provided: 

1. A complete list of resource requirements, 

2. A statement of tasks to be accomplished and 
services to be rendered, 

3. A statement of adopter average prices, wages, 
and benefits for those resources required by 
the program in an operational setting, 

4. A statement of representative hours which the 
adopter can expect to allocate to program tasks 
and services in operational setting . 

a • Alternately , the average adopter market 

effective wage for various types of opera- 
tional staff . 

5. In the setting of this study, the resource alloca- 
tions to the categories of activity described in 
the previous chapter . 

6. A statement of those resource quantities which are 
available at zero additional cost to the local 
educational agency (e.g., unused space or equipment). 

7. A statement of various task accomplishment or 
productivity measures, e.g., number of fttudents 
recruited, number of participants contacted by 
telephone, number of community resource slots 
recruited . 

The previous list implies that resource allocations 
are maintained in three dimensions: resources, research 
and development standard categories, and prograni compon- 
ents, or tasks and services. The list of task and service 
requirements is a refinement of the list of research and 
development subproducts discussed in Chapter Three. The 
major refinement is to delineate the instructional process, 
comiTiunity resources, and governance subproducts more fully. 
The requirements for additional detail increase as one 
moves from estimating Level A to estimating Level C, 
Therefore, the data required for estim.atcs of service 
delivery can be based on the reporting system for develop- 
ment costs when modified by the refinements stated above. 

If data does not exist to satisfy each of the seven 
requiromonts stated above, then estimation is based on 
asnurnpt: ions . Such assumptions should be clearly stated . 
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For example, data may not be available to estimate the 
effective wage of operational staff. In that case, one 
may assume that the average number of hours per time period 
to^bc allocated by adopter staff to the program is equal 
to (or is X times) the average number of hours actually 
allocated per week by development staff. Then the effec- 
tive adopter wage will be the development staff effective 
wage multiplied by the ratio of operational to developmental 
salaries, all multiplied by 1/X. The assumed relation of 
the actual work week of developmental staff to that of 
operational staffs here the value of sh^viid be made 
explicit • 

I. Estimates of Adopter Service 
Delivery Costs (Level A) 

It v/ill be recalled that the problem is to give a 
reasonable esuiinate of the acquisition and operational 
costs of the program at the level of activity and the 
configuration of service identical to measurement site > 
Both exploratory and incremental estimates are required 
for each of acquisition and operational costs, 

A. The Exploratory Estimate 

1. Operational Cost 

The exploratory estimate of operational cost 
is based on the data generated from reporting 
the research and development costs. Specifically, 
the following : 

a. The time allocation Qf personnel to research 
and development activities , 

b. The adopter average wages for required per- 
sonnel , 

c. The adopter average hours actually w^orked 
per time period for required personnel, 

d. The allocation of otlier resources to each of 
the research and development activities, 

e. Adopter average price for such nonpersonnel 
resources . 

The resource allocation information of "a" and "d" 
requirements are collected on the basis of the 
ropcjrLing nyctcrn dormer ibcd in Chapter Three, The 
values which satisfy the remaining data require- 
ments would have to be developed or be assumed. 
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On that basis it will be possible to construct a 
chart such as Chart I. The data is entered 
either on the basis of directly traced or pro- 
rated assicjniuonts . One step is the exclusion of 
resource allocations to activities which are 
clearly not opf rational. We assume the activi- 
ties of Product Finishing, Fundor Negotiation and 
Liaison, Site Negotiation and Liaison, Documenta- 
tion, and Diffusior* to be those not found in an 
operational setcing. These are c^xcluded from 
Chart I. The activities of Design, Application, 
Evaluation, Staff Recruitment and Training, and 
General Management, Housekeeping, and Clerical 
remain . 

The next step is to enter all personnel, 
and some nonpersonnel resource allocations in 
physical units and the remaining nonpersonnel 
in dollar units into Chart I. This is based on 
the assumption that wages and salaries will vary 
from region to region and from research and 
development to operational sites but that non- 
personnel prices are more nearly constant as 
between application in research and development 
and in operational settings and across areas of 
the country. 

An exception to recording personnel resource 
allocations in terms of physical units is that of 
consultants and other nonprogram personnel. These 
are valued in dollar terms for reasons similar to 
nonpersonnel resources . 

The next step is to assign dollar values to staff 
personnel resources. To do so, we use national 
average personnel compensation values for operational 
settings • These may be adjusted for differences in 
actual hours of work. If we let 

1. w. = /werage national effective rate of 

compensation , where 

2. Wj^ MC^/Lj^ , the quotient of average monetary 

value of compensation divided by average 
actual time allocation , then 

^- ^i.h = (^i.k^ • 

This is the value which is entered as the adopter 
exploratory estimate of personnel cost. 
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The value for nonpcrsonnel resources is entered in 
line 26. This may be calculated from values based on 
national average prices or developer prices, if the 
assumption is made that nonperscnnel goods and service 
prices do not vary greatly as between developers and 
adopters . 

To this point, dollar values have been entered for 
all resources traced to the five activities noted in 
the column headings of the chart. The next task is to 
prorate the costs of Staff Recruitment and Training 
and General Management, Housekeeping, and Clerical to 
those of Design, Application, and Evaluation. This 
is accomplished as follows. First determine the total 
of all staff time directl y traced to eac'h research and 
development activity Gxcluding staff recruitment and 
general management. Denote this as, 

4. L* _ = 8 L* 1. . 

k=l 

Then form these ratios, 

5. L* /L* , L* ^ , and L* _/L* 



the ratios of time allocation of Design, Application, 
and Evaluation to total time allocation. 



The ratios aro applied to the costs of the two 
activities to be prorated, (C q + C in) to form the 
products. 



7. L' 



8. L 



A 



A 
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These are entored in the row titled Assignment for 
Estinuite and added respectively to the totals for 
each activity or C i, C 2> ^ 3* "^^^ sum is indi- 
cated as C^^i ' ^V!2 ' and ccj'. 

The lov/er exploratory estimate of operational 
costs is 

9. eg = C?.2 - C..2 + 

The upper exploratory estimate of operational costs 



IS 



10. C.e - 1 + o + 



u 



. .1 

3 



. .2 



. .3 ' 



It will be recalled that costs of some facilities and 
equipment have been excluded from the above estimate. 
They nay be included by prorating the costs of tnese 
resources allocated to Staff Recruitment and Training 
and General Management, Housekeeping, and Clerical to 
those of Design, Application, and Evaluation. The 
value determined for Application is then added to the 
lower estimate. The value determined for the cum of 
Design, Application, and Evaluation is added to~the 
upper estimate. 

V7e must specifically state that the resources 
allocated to any secondary products (e.g., special 
research studies) arc excluded from those used for 
estimation. In addition the allocation of resources 
and costs due to personnel not in "operational" assign- 
ments are also to be excluded from the upper estimate. 

Estimation based on this process can be made at 
any time. However, we feel that the estimates will 
best approximate the true value if estimates are made 
after the program is operating at its projected level of 
operation. We are not concerned at this point with the 
deployment and cost of resource allocation to tasks and 
services within the program. Therefore it will not be 
necessary to construct the estimate for a period suf- 
ficiently loncj to include a full program cycle. 

The estimate may be expressed as a dollar rate per 
year or per month. The estimate may be based on as 
little as one month's cost Dehavior, if necessary. 
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A longer period is preferable, however, in order to avoid 
an estimate biased by the presence of special factors 
operating within a given month. 

F ur the rmo r e , the range be tween the uppe r and lower 
estimcite can be expected to diminish the more closely 
the program approximates an operational character at 
the points of measurement • Therefore , cost estimates 
based on experience toward conclusion of the development 
program or on field test application can be anticipated 
to produce the best estimates. 

2. Acquisition Cost 

The ease with which operational costs are esti- 
mated is a consequence of their tendency to repeat 
period after period. This means there are many 
potential points of measurement. Moreover, if we 
assume that the adopter v;ill be led to exactly dup- 
licate the program, we can neglect the specific 
tasks which comprise the program and focus on total 
costs . 

In the estimation of acquisition costs , one 
difficulty is that acquisition tasks do not repeat 
themselves. Therefore, if acquisition costs are 
not recorded when in process, they cannot be meas- 
ured as acquisition processes later during develop- 
ment. 

Sl^ould data be retained, estimates derived from 
them cire likely to be in error on the high side. In 
the first place, these costs v;ill include considerable 
trial and error as developers seek to find a proced- 
ure v;hich accomplishes the ends desired; procedures 
V7ill be modified . Secondly , even for the preferred 
procedure, experience in the acquisition period will 
not have developed learning (and hence proficiency) 
of staff to the point that will occur later. 

Also, in the research and development environment, 
acquisition of resources to apply designed techniques 
and m.aterials is frequently based on a level of 
activity less than that ultimately desired and on 
which the estimate is to be based. Moreover, acqui- 
sition tasks based on increas: ng the level of appli-- 
cation activity are likely to be pursued contempor- 
aneously with application services rendered to 
students. Thus, acquisition of capacity is diffi- 
cult to separate from the application of that 
capacity. There will be no clear period when 
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acquisition activi'-v is separate from other activity 
during development . 

Consecjuont.l y , to formulate an estimate of 
acquisition costs ^ we must construct a list o f 
acquisition tasks based on judgment as to require- 
ments for the specified level of operational activ-- 
ity v/hich is the basis of the exploratory estimate 
of operational cost . Then estimates of the quanti- 
ties of resources and costs required for those 
tasks can be assigned. 

The accuracy of estim.ation will be increased 
to the degree that m.odif ications , previously 
mentioT'^d, v;hich increase slightly the detail of 
the reporting system, are made. These modifica- 
tions establish subcategories v/hich take account 
of the separation of acquisition from operational 
effort. For example, in our illustration based 
on EBCE, it v/ould be productive to modify Govern- 
ance and Corrjiiunity Resource utilization. Gov- 
ernance could be divided into a category for 
Recruitment Selection and Formation, and another 
for Governance Conduct. Sim.ilarly, Community 
Resource Utilization either should be defined to 
include only site recruitment and resource person 
identification and analysis or should be subdivided 
so that such activity is separated frorri other 
activity pertaining to community resource utiliza- 
tion . 

In Chart II, illustrative acquisition tasks 
based on EBCE are listed horizontally across the 
top of page as column headings . Resources are 
listed vertically as row headings. The resource 
listing is similar to Chart I. It must be remembered 
that a third dimension includes research and develop- 
ment activities not excluded due to being peculiar 
only to research and development effort. Due to 
this, there must be a separate chart for upper and 
lower estimates . Chart II is for lower estimates . 
That is , the quantities entered for program staff 
are the measured values for Application activity 
plus an assignment from the proration of Staff 
Hiring and Training and from General Management, 
Housekeeping, and Clerical. The same applies to 
dollar value entries in lines 17 through 24. A 
chart for calculation of the upper estimate v/ould 
incJ.ude measured values for Design and Evaluation 
of operational staff as well as Application. 
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CHART II 




Completion of such a chart can be made on the 
basis of mcasuronents taken in the acquisition phase 
of research and development ^ application, or field 
testing. Tho latter oifcrs the best opportunity 
to measure acquisition tasks during an acquisition 
period as such. 

IIov;ever , due to the problems stated above, many 
acquisition task resource requirements must be 
constructed on the basis of judgment. To do this 
requires : 

1, A statement of the number of students to be 
served ♦ (This is based on the operational 
estimate) , ^ 

2, A statement of the program resources and 
materials which must be available to the 
student if he is to be rendered services 
(e.g., number of learning sites, learning 
packages) , 

3. A m.easuro of the total allocation of staff 
resources to replenish such materials 
over the course of some time period, 

4. A measure of the number of units of output 
of such effort (e.g. , number of community 
resources recruited, number of learning 
packages formni ated) 

Consider the category, acquisition uf human 
resources. It will be known that a specified number 
of studenlb are to be recruited. Based on operating 
experience and given the number of students (in the 
program) the number of community resource slots can 
be predicted. Also the composition and number of 
individuals in the governance unit can be specified. 
Let 

11. Qg = The number of students enrolled at any 

time . 

12. N^j^ = The number of units of the j^^ 

intermediate product-^ required 
per student . 



1, An intermediate product is a product used in the oroduction 
of another [;roduct. Here a student and a resource slot are 
intermediate products . 
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student recruitment and community resource recruit- 
ment and analysis are activities that take place 
both during acquisition and during operations. During 
operations, activity allocated to such tasks should 
be reported. If it is, then the quantities of time 
by each of several personnel resources will be known. 
Let 



13. 



14. 



The resource al location to the j 
task by the i^^^ personnel staff 
resource over the period. 

The cost allocation to the j^^'^ task 
by the i^^'^ nonpersonnel resource 
over the period • 



Records of the productivity of resource alloca- 
tions should be maintained. On the basis of such 
data; the total number of students recruited and 
community resources developed will be known. Let 
this be 



15. 



X 



= The number of unirs of the j^^ 
' ' intermediate product due to 

resources allocated to the j^^ 
task over the time period 

Then the number of resources vhich must be acquired for 



16 . 



students can be estimated as 



L 

= 



X 



(FT . ) (Q^) , or 



the quantity of the i^^ resource v/hich must be allo- 
cated to acquire the j^^ intermediate product (student 
recruits^ community resource slots). The cost is given 
as 



17. 
18. 



= (^i j . ) (^i) for staff personnel and 
(Cij 



, ) (Q ) for other resources. 



The value , Wj_ is understood as before . One can sum 
over all resources to determine total estimated cost 
remembering to apply the procedure outlined in estimat- 
ing operational costs. There will be an upper and 
lower estimate* The tv;o will ditfor^ it will be 
reiaeiaberod ^ by Design and Evaluation costs du(^. to 
operational personnel • 
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Not all acquicitior* task costs can be estimated 
on the basiis of operational experience. For example, 
faci].ity acquisition is not recurring. If no records 
e>:ist to wotc the actual allocation to this task, 
then an estimate based on memory and judgment must bo 
substituted for measured quantities. Such estimates 
should be structured around the processes described 
above. That is^ estimates sliould be in terms of time 
allocations of staff. An upper and lower estimate 
should be made . For personnel resources , effective 
v;age rates built on adopter averages should be used 
to calculate personnel costs. 

One v:arning . V7e have considered the exploratory 
estimates i:o be very rough. The estimation process 
for acquisition cos^ r> just doscr t bed contains the 
proration of some fixed resources which will, in 
fact, not be divisible. The estimate may provide 
for the identification of such resources and for 
adjustmicnts based on judgment. This will complicate 
the process. V7e have proceeded with the sim.pler 
process since it seems adequate for the rough estimate 
it is and provides an estimated range of cost in any 
case. 

B. Incremental Estim.ate 

The incremental estimate differs from the exploratory 
estimate in two ways: 

1. Local effective wages are substituted by the 
adopter for national averages of wages paid by 
all adopters. 

2 . The adopter inspects the resource requirements 

in order to determine which of them are available 
at no additional cost to the adopting unit. 

1. Operational Costs 

In order to estimate operational costs, the 
quanti ties of personnel and nonpersonnel resources 
in Chart I, after proration of Staff Recruitment 
and Training and General Managerial, Housekeeping 
and Clerical, must be provided to the adopter on 
an item by ite^ bas^s. The proration formula 
continues as L i/L,.s but is applied to each 
resource indiviciually . 
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chart III provides an illustrative format for 
tho lower ostln^^te of operational costs. The first 
colunin lists the individual types of resources. In 
tho first: nivilv.'rocl Co1u::mi (1), tho physical units 
for each resource are entered, Tho'^e will be based 
on Columns (1), (3)^ and (5) of Chart I, plus the 
adjustment due to the prorated share of Staff Recruit- 
ment and of General Manaoement. wSince this is a 
lower estimate , the resource a Sv^ignments traced or 
prorated to Application would be entered. For the 
upper estimate the sum of each resource assigned to 
Design, Application, and Evaluation would be entered. 
Column (2) converts these values (e.g., hours) into 
unit quantities (e.g., num.ber of employees). Total 
hours are divided by the average hours worked per 
position unit and rounding. Column (3) provides an 
opportunity to adjust the estimated quantity for 
indivisibilities. That is, included in the pro- 
ration process are fixed resources which will be the 
same regardless of the level of activity. For 
example, proration may result in a value of 1/2 
telephone per staff person. Standard practice may 
assign one per person. Column (3) , Adjusted Gross 
Positionj, provides for that kind of adjustment. 
If no adjustment is made the entry from Column (2) 
is repeated . 

Some of the gross resource requirements may be 
available at no incremental cost to the adopter. 
The number of units fur these resources is entered 
in Column (5) in the same units as in Column (4). 

In Column (5) , the net incremental resource 
requirements are entered. The value is the dif- 
ference between gross and net requirements. 

The incremental cost for each resource is 
obtained by entering the effective v;age or price 
experienced in the adopter market in Column (7). 
The product of the physical value of Column (5) 
and the price of Column (6) is entered in Column (7). 

For some resources (for example , expendable 
materials and supplies ) a sim.ple aggregation and 
listing of cost will be entered on a prorated basis 
directly in Column (7). 

In any case, the adopter again modifies the 
quantity required to account for fractions which 
arc not sensible and applies price values which 
fit hi.s case in order to arrive at tho incremental 
cost of opi^rn ling the program* 
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CHART III 
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• when consideriny facilities and office 
equipment, the adoptc^r entry will depend on the 
means chosen to acquire those resources. For 
example, if the resource is to be rented, then the 
cost will appear as an operating cost. If the 
resource is to be purchased, then it will not be 
considered as an operating cost but as an acqui-- 
sition cost . If previously constructed , a zero 
cost entry will be made, but if specially provided, 
a positive cost will bo recorded. In such a case 
some capital consumption factor should be applied. 

The implication of this is that whether a given 
resource is classified as an acquisition or opera- 
tional requirement v/ill depend on the miannar in 
which it is to be financed. This problem cannot 
be avoided. It can only be solved by allowing the 
adopter to cost out the program based not only 
on his resource availabilities and his prices, 
but also on his method of finance and procurement. 

2. Acquisition Costs 

A chart similar to that of Chart III is prepared 
to estimate acquisition costs. The basis may be any 
of the sources referred to when discussing explora- 
tory esr^imates of acquisition costs. Data may be 
taken from acquisition during research and develop- 
ment, from observation of recurring tasks during 
operations which are also required in acquisition^ 
from judgment and memory where no records exist, 
and finally from records of field test acquisition 
costs . The latter will provide the best opportunity . 
The same list of resources appears in the left 
column. The quantity and cost entries are those 
necessary to accomplish the tasks denoted in Chart 
II. Again the adopter computes cost by applying 
price factors which prevail in his market after 
exc luding resources available at no incremental 
cost. Tlie attribution of the cost of capital 
resources again depends on the means of their 
provision, and of course there must be consistency 
in this regard v;ith respect to acquisition and 
operational estimates. Again, there will be a 
lower and upper estimate derived due to upper and 
lower estimates of personnel requirements. 
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C, Summary 



This section has discussed the estimation of cost 
when tho dovolo[jod jn^ogram is installed and operated 
"as is" by the adopter. The quantity of students 
served and the kinds and quantities of services offered 
to them are assumed to be identical to the development 
setting. For this reason, we did not concern ourselves 
with fixed and variable costs, resource indivisibilities, 
or the allocation of cost to each of several acquisi- 
tion tasks or operational services • 

One set of estimates provides upper and lower ex- 
ploratory estimates. Averages of adopter effective 
rates of m.onetary compensation are applied to quantities 
of resources recorded under the reporting system o f 
Chapter Three. Lov;er estimates utilize resource allo- 
cations to Application activity plus a prorated share 
of Staff Recruitment and Training and of General Manage- 
ment, Household, and Clerical activity. The upper esti- 
mate adds operational resources allocated to Design and 
Evaluation activity; to these are added the prorated 
share of the Staff Recruitment and General Management 
activity . 

The second, more detailed, estimtate is that of 
adopter incremental cost. Again upper and lov;er esti- 
mates are provided. The estimated adopLer incrcm^ental 
cost requires that a list of required resources be 
specified in detail. Resources are costed using prices 
and wages prevailing in the adopter market. A zero cost 
is entered for resources which can be m.ade available 
by the adopter at no incremental cost to himself. 

In order to facilitate estimation of acquisition 
costs, the subproduct categories specified for the 
reporting system in Chapter Three must be modified by 
a slight increase in detail. ' 

II . Estimates Under Conditions of 
Variable Levels of Activity 

Estimates of tlie resource requirements and cost when 
changes in the program activity level or structure are per- 
mitted ir.; a much more tenuous task than that just described. 
The estimates will have much larger error. 

In order to provide accurate estimates of cost under 
changing levrjls cf activity thu production function of the 
progr<\r. \\\u:\t ]y..) known in detail. ThaL is, one need:: to 
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know how the quantities of each kind of resource respond to 
chcinges in the required level of activity (number of gradu-- 
Qtes) • If the program were ob^^erved in many different 
settingjj and at many different leveJ.s of activity, a statis 
tical history would be available. Baced on that experience 
a relation between activity level and resource requirements 
could be formulated by means of regression analysis. 

The defining characteristic of developmental programs, 
hov;ever, is the absence of such a history. Regardless of 
the level of detail "of data collected to describe the pro- 
gram it v;ill still be the case that the variety of recorded 
experiences will be limited in the extreme . Observations 
are limited to development and any fie].d test. This being 
the case there will be no basis upon which rigorous predic- 
tions of cost can be formulated. It cannot be cm,phasized 
enough that any estimates on such a restricted basis must 
be used with caution. This being the case, how is one to 
proceed? 

One approach to the problem would be to determine the 
ratio of desired activity to observed activity: 

1, Let = level of observed activity 

2, Let = level of desired activity 

3, Then X^/YP - rates of desired to observed activity. 

= Expansion Factor = k 

By observed activity we mean the values of output and 
resource requirements derived at the development or field 
test site. These will be based on actual experience. The 
Expansion Factor can then be applied to all observed 
values of resource requirements, costs, and money payments 
in order to produce estimated values. 

That is, suppose that observed upper and lower explora- 
tory estimates are denoted by 

4, - Lower observed exploratory estimate, and 

5, " Upper observed exploratory estimate, 

then the estimates for desired levels of activity using 
the expansion factor are produced as follov/s 

Lower desired exploratory estimate, 

(k) (Eg); 

Upper desired exploratory estimate , 
(k) (E?i) , 
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In estimating the incroiaental estima te one proceeds 
similarly. Estim.ation starts with the observed level of 
activity a.s outlined in the previous section (I) . The 
result wil.l be 

10 • e^ - Lower observed incremental estimate 
L 

£.0 - Upper observed incremental estimate 

The estimates for the desired levels of activity are pro- 
duced, as above, throuyh application of the expansion 
factor, k. That is, 

11. ^ (k) (ef ) , and 

eg - (k) (eg) . 

This approach relies on a major assumption. It assumes 
either 

a. That all resource requirements and costs change in 
direct proportion to the level of activity, or 

b. That, v/hile each resource requirement and cost does 
not change in proportion to activity, the aggregate 
effect on cost is proportional 

In analysis of this problem one must define the context. 
Is the analysis one of long run behavior? In this case, 
the choice situation is taken to be one in which the decision 
maker has full freedom in specifying the kinds and quantities 
of all resources needed to best attain the desired level of 
output activity. Or is the analysis one of short run? In 
this case, the choice situation is restricted; the decision 
maker does not have full freedom to specify the kinds and 
quantities of some resources. Some must be taken as given. 
The usual example is output expansion under conditions where 
building and fixed equipment may not be changed. 

In short run analysis most studies show that averag e 
cost v^arics v/ith output. The usual textbook relation is 
assumed to U shaped. Average costs first decline and 
then increase • This r^'sult is due to the interaction of 
average cor;t due to fixed resources and of average cost 
duo to variable resources. Average fixed cost diminishes 
as out t-^ut activity increases; fixed costs are spread over 
mota: unius. A\'erag(' variable costs first decline and then 
increase. TJiis is due to one resource having less and 
leS5; of the other to work with beyond soii.e optimal produc- 
tion ; r^)por I- i f n^. . At [\(.a\\v pcint the increase in average 
^/a? i iM(: (jorl,. Mvr('"r[:; tl'.r' ci (..'c: r L'..i o in a\^f^rnqc} fixed 
cu5;ts and tulai costs rj.se. Not all eviaence supports 
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thill statonicnt; some studies find constant avera ge costs 
over an extensive range of output activity. Under the 
former condition ; application of the expansion factor, k, 
to obuorved oi;Ln iv.a tes v;ill be in error. In the second case, 
that oi constant average costs / the application ol the 
expansion factor produces accurate estimates • 

In the analysis of cost when long run analysis applies, 
the decision maker is no longer perceived as adapting a 
given facility to changed levels of output activity. Instead 
the problem is perceived as one of choosing the optimal 
facility. 

The-} usual cissnmption in analysis of long run cost behavior 
is that if all resources are doubled, then output doubles • 
This is called constant returns to scale. In this case 
application of the expansion factor produces acceptable 
results. Many studies confirm- the above assumption,. 

It is our feeling that the problem studied in this sec- 
tion is a long run problem . The adopter is choosing a 
desired level of output activity and also the best arrange- 
ment for providing that level of service without constraint. 
Two other factors need consideration. These are the following: 

a. The presence of indivisibilities. 

b. The response of estimates due to the method used in 
the preceding section. 

1. Effect on design and evaluation of changes in 
output activity . 

2 . Incrementally free" resources . 

Indivisibility is the characteristic of commodities that 
refers to the degree to v;hich they are divisible. A resource 
is divisible if it is possible to procure it in any fractional 
quantity. Gasoline, butter, and electricity are infinitely 
divisible. Commodities v;hich are not infinitely divisible 
are said to bo indivisible. They can be obtained only in 
whole, nonf ract ional , units. The presence of indivisibilities 
impocor:; discontinuities in resource requirements and cost 
responr>e. Some indivisibilities are institutionally imposed: 
V/hile it may be possible to hire a staff member for any number 
of hours (e.g., a babysitter), institutional regulations may 
prc;}ii.bit hiring of staff in quantities other than full or half 
days. The rer-rait is that resource requirements become invariant 
over ranges of output activity. In the case of career educa- 
tion projcjcts, the number of staff will not change over certain 
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levels ot" student :j or clients. The acceptable case or 
student load for a full time staff member may be defined, 
for example^ to bo anywhere betv;cen 35 and 80 individuals. 
In that case ruh.;ourco roc]in rementJ-3 foi* such staff may not 
change when activity is increased. ,ror example a change 
from 35 to 70 students will not require additional staff.) 
A change of enrcllraent from its present (observed) level will 
result in a change of staff employment which in no case 
exceeds the proportionate change in output activity. This 
means that 

Staff Expansion 
0 C Factor " 

The actual change will depend on the upper (e.g., 70) 
and lower value (e.g., 35) of student staff ratio and the 
value of the accual observed ratio (e.g., 35 or 65), 

Our estimation methods for observed program behavior must 
also be considered. The first of these is the formation of 
upper limit estimates based on the inclusion of Design and 
Evaluation activity in the estimate as v;ell as the prorated 
shares of two other categories of activity. The second is 
the construction of estimated increm.ental costs wherein the 
adopter reduces resource requirements to the degree tha€*^* 
such cost (zero cost) resources are available to him. 

In the first case, one must ask whether the levels of 
design and evaluation activity present at the measurement 
site would increase proportionately to i.ncreases in the 
number of students or clients to which the developmental 
program is app'i^.l. To what degree will the nuiT±)er of 
students affect design activity? To wliat degree will the 
number of student'^ affect the level of evaluation activity? 

Aj.so included in the estimation process are the prorated 
shares nf Staff Recruitment and Training and of General 
Management, Housekeeping and Clerical. To what degree can 
these be expected to change in response to changed student 
enrollment? 

Secondly, in the construction of incremental estimates, 
the adopter has adjusted resource requirements by subtracting 
the quantities of those resources available to him at no cost. 
The remainder constituted his incremental cost. Where re- 
sources are available to the adopter, the incremental cost 
estimate may be expected to more than double in response to 
a doubling of total resource requirem.cnts . 
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^ • ExiJloratory I'stiraatos 

Exploratory cost cGtimates will be based on several 
asGuniptions , 

1. Me assume tliat ap plicatio n activity is pro- 
portional to the expansion factor, k, 

2. We assume that increasing the level of output 
activity will not directly affect the level of 
Design or Evaluation, 

3. The consequence of this is that an increase in 
output activity will increase Staff Recruitment 
and Training activity by k times L'*^ 2^^, ,8 • 

1. Operating Costs 

To construct the exploratory estimate of 
operating costs the upper and lower estimates based 
on the observed level of output activity are formu- 
lated. The result is denoted as in statements 4 
and 5, Eg and E^j where the "o" superscript denotes 
observed values. 

The lower exploratory estimate of operating 
. cost at the desired level of output activity is 
formulated by 

Eg = (k) (Eg) 

as in statement 7. 

The consequence of our assumptions is that the 
upper exploratory estimate of operation cost at the 
desired level of output activity is formulated by 

13. Eg (k) (E^) + (Eg - Eg) , or 

14. E^ - Eg 4- (k-1) (Eg) • 

2, Acquisition Costs 

An identical process is employed. Acquisition 
tasks are formulated on the basis of operational 
requircmoiits . Resource allocations and costs, are 
assigned . The lower estimate is increased a factor 
of k. The upper estimate is increased adding (k-1) 
(EO). 
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Incremental Cor.t Kstimatc 



The same assumptions apply to the incremental as to 
the explc-ratory OiJtiniate^ A.lso, the same .procedure v/ill 
be applied to operational and acquisition costs. 

The reader should refer to Chart III, page 61. 
Denote the observed value for each estimated quantity 
entered in Column (2) as 

15. (Q£,)j_ = The lower observed resource quantity estimate 

for the i^^ resource, and 

16 . (Q^) j_ = The upper observed resource quantity esti- 

mate for the i^^ resource. 

The desired lower and upper resource quantity esti- 
mates are denoted as 

17. (Q^^j^ " "^^^ lov;er desired resource quantity esti- 

mate for the i^^^ resource and 

18 • (Qu^ * "^^^ upper desired resource quantity esti- 
mate for the i^^ resource , 

and are calculated as~follows, 

19. (Q^) ^ = (k) (Ql) . 

20. (Qg)i = (Q8)i + (k"l) (Q^). 

These values are entered in a chart of the same format as 
Chart III in the columns headed as Estimated Quantity. 
There will be a chart for each of the lower and upper 
estimate calculations . 

From this point the procedure is the same as appl led 
for the exploratory estimate in the preceding section. 
The adopter enters the num^ber of positions in the columns 
headed Estimated Gross Positions. The next step is to 
impose judgment upon these, and enter the result in the 
column headed 7ul justed Gross Positions. The quantities 
of resources availabJ.e from adopter supplies at no incre- 
mental cost are specified and entered as before. These 
values are subtracted from gross poiij.tion r equ j.remcnts 
to dctoriaine not position requirements, the value of which 
is entca*ed in the column of that heading. The effective 
ado;jtor v;ac,os and prices are applied to the net quantities 
to d e t e r 1 :\ i. n e tin: c s t j. iua ted i n c r c : iwc n t a 1 costs. 
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In the case of acquisition requirements the point 
of departure is the data of Chart II. Acquisition 
tasks arc^ listed and the quantity of each kind of resource 
entiraatod accordinq to statements 19 and 20. The quanti- 
ties are totaled for each resource and entered in the 
Estimated Quantity column in Chart III. From that point 
on the process is the same. 

Again the method of procurement of capital resources 
will determine whether they are costed as an operational 
or an acquisition cost or included as an incremental cost 
at all. 



III. Estimation of Service Delivery Costs Under 
Condition of Changed Program Configuration 

By program configuration we mean the level of activity 
established for each kind of treatment service (or production 
procedure) and planned outcome. In the previous sect/.ons^ it 
was assumed that either 

1. the program was to be duplicated exactly as found at 
the development site or 

2. the program v/as to be expanded or contracted in a 
proportionate manner such that its relative emphasis 
on student services and treatments and/or student 
behavioral results was unchanged. 

An adopter may, hov/ever, wish to provide more or less of, 
or to eliminate, any given treatment. Likewise he may desire 
to expand, contract, or eliminate a particular student behav- 
ior result. This section discusses the estimation of cost 
when the adopter manipulates the services rendered to, and 
results expected of, students. The only restriction is that 
while some services and expected results may be eliminated 
no new service or expected result may be added. 

To approach this problem, the degree of detail of data 
collection and computation must be expanded. Much of the 
added detail can be superimposed upon the system described 
in the previous chapter. In particular, tlie system must 
record the allocation and cost of resources allocated to 
program services and expected results. These will often be 
easily associated with the subproducts of the primary devel- 
opment product . 

The specification of data collection in terms of program 
servi ccs and expected results coincides v/ith the require- 
ment to fully explain i;rogram operation to the adopter. It 
is exactly these services and expected results that should 
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comprise the terms of procjram explanation and instruction 
to the adopter, even in circumstances where cost estimation 
is not an objective. A data collection system expressed in 
the sor-e turr:::. provides additional information — staff and 
nonr. Laif reijource allocations tocjetlier v;ith an operational 
statumctnt of personnel job task descriptions for the accom- 
pli r.hment of each program service. 

Program services and expected results will differ from 
program to program. Therefore, the service; and results 
specified for data collection will be unique to each pro- 
gram.. A first task in the. design of the data system is 
to carefully describe program services and expected results* 

The illuiitra tion of program subproducts and secondary 
products offered in Chapter Three vras based on the EBCE 
devc'lopm.ent projects. That project will continue as the 
basiLi of illustration in this chapter. 

The dimensions and the elements of each are similar to 
those discussed in Chapter Three. One dimension is that of 
reseai'ch and development activities. A second is that of 
resources. These are unchanged. The third dimension is that 
of subproducts and secondary products. It is this dim.ension 
which m.ust be expanded to accommodate the services and out- 
puts of the program. 

Chart IV lists the elements of this dimension* The 
expected results are basic skills, life skills, and career 
development. The remaining categories are treatment elements 
and services of the program. The characteristics of the data 
collection system in term;S of reporting of resource alloc:a- 
tion are the sam^e as those discussed in Chapter Three. 

The data collected in terrvS of this framev;ork can be 
organized into tv/o formats, one orierited toward program 
operation and the other tovard acnuisition . As before, 
acquisition requirem,ents are often derived from operational 
requirements. Charts V and VI are illustrative. These 
should bo compared with Chart II of Chapter Three. It will 
be seen that the categories recomm.ended here generally rep- 
resent a further detailing of developm.ent subproducts. 
For exam.ple, thu services listed under execution include the 
basic skills, life skills, and career development subproducts 
The process of execution is an element of instructional 
system and the means includes substantial aspects of guidance 



1. See page G]. , Oiapter 3. 
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CHART IV 

EBCE Program Services and Services by Output 



Program Servicos to Students 

1. Student Recruitment and Selection 

2. Student Orientation 
3 . Long Range Planning 

4. Short Range Planning 

5. Execution (by Results) 

6. Exploration Level - basic skills 

7 . Exploration Level - life skills 

8. Exploration Level - career development 

9. Learning Projects - basic skills 

10 . Learning Projects - life skills 

11. Learning Projects - career development 

12. Specialization Level - basic skills 

13. Specialization Level - life skills 

14. Specialization Level - career development 

15. Single Objective Projects - basic skills 

16. Single Objective Projects - life skills 

17. Single Objective Projects - career developmient 
1.8. Personal Affairs and Problems 

19. Progress Monitoring and Assessment 



Facilitating Services 

20. Community Resources - recruitment and development 

?1. Governance - recruitment and formation 

22. Governance - conduct of effort 

23. Program Materials Development 

24. Staff Recruitment and Training 



Suppor t Services 



25. Transportation - acquisition 

26. Transportation ~ operation 

27. Food Services - acquisition 

28. Food Services - operation 

29. Legal Operation - acquisition 

30. Legal Operation - operation 

31. Student Insurance - acquisitions 

32. Student Insurance - operations 
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In any case, oui purpose here is not to dcfGnd in detail 
this particular conceptuali:'.ation of the ^^yi^tem but to illus- 
trate thc^ requircMuont that a composite set of program services 
and results be defiiied and that the dc^scription not conflict 
with; and indc:cd onhanco thLi structure of subproducts ui^ed 
for procjram development budget and accounting reporting. 

At this point, before we suggest the method for providing 
the desired estim.ates, a v/ord of caution. The estimation of 
costs under varied services and levels of results will be 
extremely precarious for any program, when the only available 
data is that of development experience, even if augmented by 
field testing data. Statistical estimation would require, the 
oboservation of the: program in many different settings. Then 
an estimation formula could be fitted to that experience. 

All of the problems mentioned before apply. The most 
basic of these is the presence of indivisibility and fixity 
of resources; . For such resources a change in the level of 
program activity simply will not occasion a proportionate 
change in indivisible or fixed resource requirements and costs 
compared v;ith development experience. There may be no change 
at all. That is why all estim.ates based on prorations have to 
be considered as suspect and subject to modification in light 
of judgment. Chart III provides for application of that judg- 
ment. The problem of change in fixed and indivisible resources 
continues to apply when the focus shifts from the program to 
its component cervices and expected results. 

An additional problem concerns the inter dependencies 
a mong program services and results . The several treatments 
and services are not maeperident of one another. For example, 
even supposing that v;e know the resource requirements and 
costs of providing student treatment through learning projects, 
one would be hesitant to predict that doubling the level of 
this service would resuJ.t in total program costs being increased 
by an amount equal to that of current learning project costs. 
Secondary effe -ts would modify chat estimate. For example, 
vjommunity resource recruitm.ent and program material development 
costs would increase since they are necessary interm.ediate 
inputs to the provision of learning pro j ec ts • 

A third problem concerns joint products. Joint products 
are tv/o or more products which are so intimately associated 
that they cannot be produced independently. V/e have assumed 
that l;asic skills, life skills, and career deve].opmtent repre- 
sent thrcH'j kinds of results and that they are independent of 
one another. To the degree that this assumption is in error 
it v;ill not be possible to discuss the change in cost occasioned 
by the independent adjustment in the level of one intended 
result. 
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The method of estimation in an application of that 
disciu>r-u?d ii' the previous two sections. The procedure is as 
follows: 

1. The cost (^1; Iho program in its dcvclopnicnt con!:icj-- 
uration is estimated at tlie desired level ot pro- 
gram activity. This requires application of tVio 
procedures discussed in Sections I and II . 

2. The chan(jes in program configuration are specified. 
We have illustrated this by suggesting that the 
student body complete twice as many learning proj- 
ects. Ar.other illustration would be elimination of 
basic education from the program. 

3. The quantities of resources which can be directly 
traced to the affected program elements must be 
identified • This can be done by tracing resource 
alloca I: i ons to the combinations of treatment/result 
and rosea rcli and development activity illustrated 
in Charts V and VI. There will be an upper and 
lower estimate of allocation as employed previously 
in Section I. 

4. The program structure sliould bo examined and induced 
changes in any otlier program elements estimated. 

5. The procedures discussed in the previous two sections 
are applied to tlie changed resource requirements in 
order to estimate the change in cost . 

6. This value is added to tlie cost of the program in its 
development configuration and desired level of activ- 
ity (Step One. ) 

To recapitulate, in order to produce a lower exploratory 
estimate of tlie operational cost of tlie effects induced by the 
change in program configuration, the char . uou rcsourc:es require- 
ments are those derived from /appl icatio n activity plus pro- 
rated Staff Rocruitiaent and General Mana-remcmt . The upiycr 
exploratory estimate adds those operation resources allocat^jd 
to Design and Kvaluation activity, with prorations similar to 
that of application activity. 

To provide an exploralory estimate of acquisition costs, 
the el feet oi the changerl conT igura tion of servicers upon 
accjui.si tion rec]ui r ement s must be dL^tt.^rir.inod . Data on the 
quantities o t: resources augmentrKl by measures of tlv.' rrr.ult 
of allocation ol those resources will l^e usfH.ui. i'or exaiap.le, 
one must esLabJish the connection bi;twcen the desir^'d number 
of learning j^rojects, the probable number ot. coramuni ty 
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resource* cont ictr. that must be made to yield the ciei^ired 
ciuant''-y, ar.d the [)rohiblc number of program re.sourcoF; 
r(.'cruxied t(; contact cr.ployeis and other manacjers uj' community 
inr.l itutU»:is. A! Um M.e acquisition r oqui remeiU'S have b-een 
r.f.H.'i" i t ieci , t!:* n[j:.cr and lower exploratory estimate:, are 
derj. ved as bH,^;. ore. 

To produce u^.eej- an:' lov.^ir est.imatcs of incremental 
costs, the pro cjs is .'^•imilar. hesourr'-o clianyes inui,t be 
specified. ii'.'v;ev» .-r , ti,e dt'tail is acjain yrc^ater.. ince thc^ 
adopter muiJt ];i.ov/ tr:o physi(':a] quantities of each resource 
Jn order to deteimine his requi.rt^monts net of those alrc-ady 
aval J able to hii;;. l*'oliov;Lng the upper and lower (Estimate of 
i^esource re::u;i V'.'^.l')) to , r -i^ov 'sccr, availabj.e at n:^ aciopte:: cost 
ai'e • '1 i ni nated and the . ipj^ropr ia to v/agos and prices charac- 
teristic of the adopter market applied. 



TV. Suminary 

Chaptej- luur l^-as discussed the estimation of service 
delivery t'o ;>:'ter.tial .. IcjpLers. On*; kind of estimate was the 
ext-^lor a L cry est i: ate. 'ih:i s ost..imate was basoid oii natj.onuJ. 
aver icje:; oi adop':er pric \s and v;aqes and included all resources. 
An upjjcr and Jov;er exploratory esiiiiaate was r.ucjgested. The 
lower estiri'j' v \s b-'.sed on the develoji'ment cictivity (jf 7-ppli- 
Cc'-ti.on. The U[);:er eotimc-ee included two otlier activities as 
well/ Du'sie.'. uw \1 v,ie;. L.^.on , IIowu'Mjr, ^-^^liy tl'^^ jesiyn and 

EvaiuaHon of c '.^ra, ion'jx staif ar^^ included Explore ':ory 
est iu\ tes of o[ J 'at.i.onj.i and acqui:.j tion cos'-s were discussed. 
Acquii itie I co.'. ; v/^^re cjrivod from ope rational recjuir ements 
and r -e n: i r ed d^ : i th- re su lts ^- f st > f f ef _ forts as weJ.l as 
the ailocciti.cn ei l ciiur resO'^rces to tiiose ef torts. 

Tne i ' '.crei :enta ■ es- imate is the S'^con^' kind o^ estimate. 
This esti:'*ate roo!. . ccy unt )f t!':e possil^Le presence of re- 
sources wiiici; :r.ay rr: ^ • Vu i la o 1 (• ..it ar cost to the adop1 e^ . 
'^'hese were s^ btr^u ted ::ron; toted, resourc<.' requirements 
incluvh.'d in tlie exploratory estimate. Vrice i and wages 
typie.il of iopt^' r nrtk'.^ts wc ^ apv-Xier.. 7\ ain upjjor and 
lower estii::ci'es './ere calculated for acquis' tion and for 
operational costs . 

A procedure ^or i^rcvid" g tiiese estimates was outlined 
for each of tiiree i /.lit ions : 

1. Tliat in w;;j.ch t! ' ad^'^pted program, identically 

duplicti^^/s the uj ogram in itr deve.l of:)m^'.*nta.L setting 
in ten:is of : rugra^- se; vice eonf igarati on ^md 
leve] of a vice acti v.i ty ; 
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2. 'J'hat in v/liich tho scjK' o£ tiu- proyram dctivity couJ.d 
bo incrocUH'd or dccrL-aLod ^ hue 1:^; vvh.ich progrdra L*.cr~ 
vico conl icjurd-i tion did not ci" ang*:.'* and 

3, That in whJcli f.i'irvicc coniiuiira tio}; v;aL; allowed to 
vary in addition to level ol dC tivity • 

Substantial di f 1: J cu.l.tius sta:.d in tl;e v/ay of accurate 
ei:;timates in tho latter tv;o circurast anc'js . Estiiuates must 
be UGC'd caul ions 1 ;^ , and not too rauch oaw bo oxi^;^'Ctcd, The 
o s t i raa t o r r. e o d s to be e spec :i. i\ 1 ^ y c i\-.'a lo. oi. resources v/h i c h 
do r/)t ehancji' or do not chanye cont IfAiously v/i.th chanyos in 
level of i^royran activity and ot in terc;0[;'.:ndenei es amony 
kinds of [^royraia i:^ rvice ana ar.ony J.inas oi proyrara results,. 
However, approache:; to each v;oro ^'.uyyestod, and we feel they 
h*ave raerit, yi\'en the dilf icul tics • 

As v;o proyrossc.d throuyh the chapter, the rop^ortiny 
systein of Chapter Tlu'ee was modified. Changes v;ere made 
in tho cateyorics included as subproducts in that chapter. 
These wore redefined as }:'royraia service's and output results. 
The result was an incre^ise in tho detail wJ fh which sub- 
products were formerly idonti f i*.id . Hov/ever, the service/ 
output configuration is consi:;tent v;it]i thei less detailed 
subproduct structure. It merely builds upon, but docs not 
replace, the previous structure of data reporting, Vv^e sug- 
gest use of the more detailed sliructure since it will n.eet 
a broader t-.et of r eyuir om-^nts , it facilitates c^.timation 
of cost for a varielrv of circumstances, continues to pro- 
vide for proyram. budget j.ny accounting reporting, and streng- 
thens the process of explanat'.ion and instruction to adopters. 
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(Expcr ii Mico ])j : ;i'ci L'uJ'cHa' lU' ucat.i on Procjraia — AL;L , Char lea^ ton 
W, VA.; liorl.c'Juy , Calii.; iJREL, Portland Ore; RBS , 
Philadelphia, l\\ . ) 

In this chaptc^r wo v/ll] d.i y.ri\F.iz the four Model II 
j^.Lter.. Wh^eru UL-oful, wu v;il] ]>cjint to ditferences among 
tiic jiidividual slLes. liov/cvcr, tor thc^ niofit part, v/c 
shall treat t^i^.i a:;, a qrou]). Thic justified since 
thor^' ha.s lyen a (jreat ai;;ount of ccni'juun effort among the 
siter* line: since a eoc.a'djnated effort in cost reporting 
ijj unu Tv/ay. /. coj:;irion i:.^M.}ting of laboratory staff, 
V/ar.h-i n-i t(;n ri.aff, and conr.iultants in Chicago, Illinoi.s, 
on OctoDLT 11 and 12 for the puri^o.se of arriving at 
eonur.on ec.i>L r<jp^;rting def ini tionij , characterizes that 
effort . 



I. Progiam Description 

riodel II generally t^rovit... career education to 
:jtudi.'iiL:>'^ at tlit^ eleventii and tv.elfth grade level. EhCE 
studijnts are rueruitod from among those enrolled in the 
traditional high school prograri. 

The objectives sought by E}3Cb are to foster 
learning, personal deve j o} >ii:ent , and career awareness 
tlirou^jii contact with tiu: adult working v/orld. Students 
who coiiiplete tiiir> i^}"^ graiu are to be as well qualified 
in those skillr. at-vc:lo[H:d Lho ti-aditional school 
programs as ar-^^ tudcnts .hose programs. In addition , 

the b'lvjj: r, ludc;.L .i to be I'/ re eor.petent in career 
related ski .d in the ordina y life skills (e.g., 

fnuw cial s! i .i ) ncctjr.sary fo^" coping v/i th adult life in 
an urb^an sotti . . In conu.^arison wi Lh the goals of Model 
III (enrol.) »:i ' :i training or ^oturn to the labor force) 
or Mod'^1 IV ement) , the '^'Ctives of P^odcl II 

air.' lh(/reroc^ , eh i\ore numer^a..) and, generally; less 
spec] 1 i c. ■ , iiodel i I goalr; are characteristic of 

f'ducii t.i onal tj . . in genural and subject to all of the 



1. Models llj" aid IV aro primarily adult, non-s tudunt , 
or i en ted . 
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difficulties which bosoL Lhoso rjoals. This doeiJ not 
deny tlio jjpocifi.city by which individual bohaviorcil 
objc'Ctivor. are defined (e.g., to bo able to count by 
tciii; from '^cro to one hundrttd) • \;e believe that such 
goals are intermediate relative to the ultimate- eonecrns 
oE cducatorr, and students. They arc more analooous to 
product s[>eci f ications tlian products. Also, these 
specific cjeals arc less distant to ultimate student choices 
than soKa: other objectives (o.cj., to find a job within 
six months of (jraduatlon, to earn a self-sufficient 
income, to hu'/e a rewarding career, or to live within 
one ' s means ) . 

EBCE not only om})hasii:es a difference in result, 
increased career awareness, Tt is also distinguished from 
traditional school prograr^s by the process through 
whieh these results are obtained. EBCL* is to attain 
its results tliroug'.i maximum reliance upon ncm- sc hool 
conmiuni.t y rL;:: vjure es an d insti iiutions. In its most e'xtremc 
and idealistie statei-icnt the process is described as 
one in which all learning takes place in a w^ork or 
empJoymcnt related setting. We now turn to a deseription 
of the hhCL process. 

In Chapter Four, wo referred to the necessity of 
recording costs in terms of program processes and results. 
The first S)eries of services in this prore.qs are thosc^ 
that focus directly up^on students and upon the changes in 
theiu Ll;at deli.ne th.e output of JliJCE. Students come into 
initial contaet with EbCE tnrou^jh recruitmen t. In recruit- 
ment, staff present the program and solicit student 
entry. Subsequent t-o recruitment, i n i. t -i a 1 a s s c s sr :en t 
takes place. If stuuents meet program requireivc;nts , they 
are admitted. 

I;cw students must attend orientation. In the service 
called orientation tv;o distinct activities take plaee. 
The first is true o ri cnl al:ion . l^y function, orientation 
provides a f uJ 1 explanation of program goals, prc^cedures, 
and reciuirehu n ts. , with opportuni ty for olarif icat Lon 
through student-staf ' iscnssion. The :.c:con ] acti.vity 
is ono whieh c^liects* uata describing the present str-te 
of the student::. Tliat data is obtained through existing 
student records, thtroucjh testing, .ind i.hrortgh. interviews 
with t.he- u'-'erJ , ^riiis Second segiiumt of the orientation 
program is in faet the transition into, or the first 
ste[) in, thc^ n^'Xt sta<ir\. lc>ng ^. liW* jvl ,i [ . Long 
rar:ge i;ianni]ig is a [;j.'ocer,M ^'oj. "Jca.ij.Mri i.ng"^ \'i m -ve the 
student is now — his interest, value, career and efiucation 
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goals, currLMit levels ol achievement, and courses and 
credits ccm:1[)1 eUed-*" as detenwlnod above "v'itli where the 
studtinL wants to be - what Lhe student wants to learn 
(about hlninell' or other thijujs) or what he wants to 
learn hov; to do, what skills or knowledre he should 
develop to pursue his current career and educational 
goals, what course and credit equivaJcnces he needs to 
meeL school graduation."-^ The time horizon which defines 
long Lerm planning is not unambiguously specified — 
"semester or (italics are ARIES') year/' The result 
of suc:h a process is a stateiLent of long-term objectives 
bro];en down int.o a seqp.ence of shorter term actions 
which are admittedly tentative but v/hich would, in sum, 
accoi:iplish the results which are the terms of the long- 
range plan. 

Short ra ncje p la nning (period planning) follows long 
ranMo'^jTlcUiniTig • Here the general objectives of the 
Ttost iiT.i;;edia le of the several periods of tlie long-range 
plan are given r.ore specific content in terms of 
definite acti.ons that v;ill be taken. In the context of 
the short-range plan the student and staff agree on 
specific learning packages, programs, and projects and 
the specific experience through which student work will 
be accomplished • 

Ilxeeu tion consists of all activities v;hich facili- 
tate student accomplishment of short-range program 
objective's. These m.ay be broken down into subactivi ties 
such as instruction, specification of learning experi- 
ences, and placement of students in employer sites. 
As undei stood here, execution does not include moni torincj 
and assessmi n I: of student progress. This activity 
con.^;ists of all those actions by which student behavior 
and nis worl: and performance is evaluated. The services 
of long-ran^: ■ pJ.a nnii .g/ short-ra n ge planni n g, execution 
am; iponi. tor i .ir j/ii^i a s j ^ ■ s i a e v] t , v; lien t a 1 : c > n a s a g 3: o u p , 
are a recuLsi\' ■ pr oee;: .;. Based on the results of the 
current pi.:rioa as eetermincd tlirough monitoring and 
assessment, long-range plans are revised, a new short- 
range pliin formulated, and a new period of execution 
begun. 



1. ];mi)loy^ >' -) nred Carrer hduealion 0[;erating Plan FY 1974 , 
Far We Tit L'lbor a' ory for I.lducational Research and 
DeveloiMiu. nt , id.': !''olsom Street, San Francisco, 
California 94103; I'llG. 
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The services closcribcd above aro (I) rcndorod 
directly to sludunts and (2) produce output related 
rt.'su;itt;. OLiu r lA'CK lU'UviooL; L^il-her are r.ot rondc^rod 
directly tc) lituduiU.L; or do not render services to them 
which directly producer output-related results. Trans- 
portation and f:ood services are illustrative of two such 
services lound bo til in LBCL and in traditional school 
t)royraras. At this pc)int vie wish to mention two other 
services, boLh of wiiicii provide unique resources neces-- 
sary to KBCb — experienee sites and resource persons and 
ex[ierience-based learning pacJ:a^jcs. EliCE staff obtain 
and develop tiiose resenirces through services wbdch v/e 
shall call uxpurience institution recruitment, resource 
si tL' and i.K:rson identification and analysis, and learning 
package development . 

The structure of EBCE services is portrayed in Chart 
I. In the diagram, students are indicated by (g,) , 
exj;ericnce sites and resour^ *e persons by (^1';/ cind learning 
materials by (jO . The diagram is not m.oant to be a 
complete flow diagram. In particular, decision rules 
have been omitted. The chart is a simple listing of 
essential KBCrJ services, portraying their general relation- 
ship to one another. School budgeted EBCE resources 
(e.g., staff, facili.ties, equi pii'/.int) are not indicated. 
It is taken as obvious that tlie services discussed above 
and services listed in Chart 1 are provided through EBCE 
staff, materials, cqnipiiient, and facilities. One task 
is to allocate those resources and their costs among 
program services described above and portrayed in Chart 
I. 



II . Description of t he Accounting Sy:^ tem.s 

A . Report i n g C a t c go i; J. c s 

The line item categori.*:; for cMy^e t of rcsc^urce 
paymontjj ui thiu flodel IT siicjs aii mM' ^invilar. 
The categoriLiS arc- ]i:;t(_:d i): (M:.irt. .nH| I.'o attcMupt 
has Ijc^en made to dorwri!": l.h' I'r'^at i^^:. v.'hich 
exist ai.ie^ng tlio catugoric.v^j cH :.c\mm(i1 II i'itos. 

It should.) be clear hliat ro If kmI, .i oii * >( m^s^ 'S , which 
occur luider transpor t<it i cmi cC pt'i in Coliin.n 1 

of Ciiart II, must lh..' ijicludi.'ci ■.(upcwh^ i <^ aiucuv t\\(' 
cafogories found .in the renujining cc^lumns, supi^osing 
that the exper.diture occurs. 
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Chart II 



(J) 



o 



4J 


W 










O 










CP 




LI 




« 


rj 




0) 










4J 




0. 
I; 






r3 

ui 




O 


r: 


LI 


O 




u 


ro 


n 


O 






in 








rj 


o 








c: 


H 


ri 






0 


u 


:j 






in 




n 




a 


u 




(: 


fj 




o 


rJ 


0 






Cm 




u 


I/) 


o 





• 


• 

0 










0 










CO 










to 
















(0 










4J 


(0 








•H 










U4 




4J 






Ci 










c: 


£•< f: 








0) 


0 




w 




ro 


U in 










i: u 


(0 


r: 




r t 




O 




w 






o 


4J 


4J 


c: 


rH 


>1 






0 


O U< 


0 


:5 




n 


> 0 








u 


rd 








o 






0 






Eh 


w 


u 





CO 

c 

H 

o 

r: 

o 

•H 

<P 
O 
CO 

c 

M 



W 
(1) 
•H 

O 

0) 
4J 

u 

(1) 

(1) 

4J 



o 

«3 

IT) 

n 

a 



0 








u 




nt 




H 










a 






c: 


•H 






0 




:3 






o 


w 


a 


u 


rH 


r 




o 


O 


0 






w 


u 


o 



cn 


• 


















•H 




















O 










c 


r: 








C) 


0 




t/J 






C V4 




nt 






d o 














4J 




n 






»H 




0 


(I) mh 




:3 


u 


w 


> 0 




t] 


o 




rJ 




c: 


x: 


o 


M 




0 




Ol4 


H 


C/3 


u 


o 



CO 

C 

f. 

O 

^: 
o 

(d 

o 

(0 

c 
u 

14 



1^ 



0) 
O 



fl4 



CO 






o 






u 












> 












a 




to 


to 




r: 










o 




t: 


•H 




0 






11 


d 


LI 


u 




C 


o 




0 






u 



o 

•H 

tn 
r: 
o 

o 



r 

o 

u 
o 



to 
a 

Cn 

d 

t: 
d 

tn 
o 

d 
. ^ 

d 



d 

n 
u 



\4 
03 
rH 

d 

'0 



o 

(0 
M 

O 

•D 
U 

•H 

H 
I 

J 
u 
d 



u 

D 
I: 



d 
o 
;:3 



§ 

Q 
0 



















r: 








to 


d 








ij 










•H 












(1) 








a 


> 








c 


d 








o 










» 
























13 




o 






•H 




a 












to 


• 


1 








in 






D 


•H 




o 






m 


d 








o 


U to 


d 




•H 


c: 


H r: 






d 


o 


0 


CO 




4J 




tn 




to 








'd 


0 


o 


fH 


d o 






a 


d 




d 




■H 




iH 




"J 




0 


O 


U4 






{n 


> 0 


U4 




ih 


V4 


rj 


d 


0 










o 


ui 




£^ 





4J 

C 

d 

to 
c 
o 
u 



4J 

o 



to 
(1) 
o 
u 

o 

o 
u 



(0 

O 





a 










n 




0 






i 


u 




•H 


















u 




r. 


d 


















o 


•H 


u 






0 H 




4> 


o 


(1) 


4J 


O 




d 


a 






•H H 


•n 


o 


in 


d 




d x: 




o 


t: 


4J 


•H 




n 




d 


in 


01 


G > 


0 




u 


0 


U 








H 


04 







Chart :i T 
(Cont . ) 



CO 



0) 



11 
o 
u 



c 
ft: 



0) 



o 

U 

O 



H 






O 








• 




<T3 








w 


C 




a* 






c 






(U 


•H 




X 




n 






'CJ 


u 


W 








O 




rj 


c 


•H 


U) 


4J 






p: 






n) 


> 




U 










O 






U 


f3 


u 




>i 


r. 


c 


tn 

r: 


0 


0 








4J 


o 


o 








a; 




•H 


li 


^: 


•H 




Pi 


c: 


u 




H 




cu 


4-» 






0 


Qi 




ui 


•H 


o 




0 




'J 




CJ 


U 




H 


•H 


.1 ' 










<T3 




o 








;i 


0 




ki 


w 


H 


P4 


o 




'/J 


u 


o 



u 
w 

•H 
P. 

;3 
CO 



(U 

o 
u 

O 



•H 

>: 

(J 
n 

fW 





tn 




























<D 










0 


















«H 










•H 


















4J 










4J 


















•H 










U 


















H 




























•H 






































o 


















:3 




4J 






M 
Di 












• 










c 






0) 








•H 




X 




ft: 


• 


c 
o 


o 










cn 


ic 


W 

n 




w 






n 














•H 


> 


o 


u 


0) 










^ 


0 










u 


u 


d 


u 






0 


>t 


c 


c 


a 






u 


o 


0 








U 


4J 


o 


o 


■H 








CQ 


u 




0) 








•H 


U 


s: 


V 


•H 


•H 








r: 










H 


a 


Cu 


-H 




V 


o 




o 


OJ 






V 


•H 


•H 


0 






C 




0 




u 




o 




a 


U 






•H 




•H 




s: 


V 




C 


a; 




o 


fO 




o 




u 




o 


V 


n 




o 






a; 




w 








Ci4 




O 


Q 




u 


o 



























v< 






O 






4i 




M 








S 


0 














0) 


c 






ft5 


04 










IQ 


w 




O 






'H 


o 


CI 




u 






•ri 


a 








y 




M 




c 





^1 

▻4I 





















1 






















H 


CI 






ns 




to 




4J 


W H 






c 


d 


u 


(/) 


0 




•H 


4J 






> 


u 




d 0 


V4 


d 








u 


4J 


w 


w 




•H 


0 






H 


•H 


V4 


0 


•H 


H 


0 


u 


U 


•H 






ns 


4J 






Em 




0 





to 
o 
u 

•H 
> 
V4 



10 

H 
4i 



CO 
0) 



O4 
O4 

CO 



0) 










f: 
































0) 










0 


























to 






'H 






d 


H 


•H 




















CO 






H 






4J 






V4 


0 


4J 




















0) 












XT 






eg 


4J 
•H 


UC 
















te 




u 

•H 


as 




•H 






•H 






H 


n 


















c 


c: 


> 


c 




CJ 




W 


4J 




H 




d 


0 










n 






CJ 


>^ 


V4 


0 




4J 




H 


D 




d 


H 




u 








D> 








u 




CJ 


CQ 




d 




d 






4J 


'(J 




a* 






in 


C 


d 




Q4 






w 






0 


'H 






r: 










CJ 


•H 






X 


CJ 






TJ 






H 


U 




r: 

0 


0 


l: 






C 


u 


U) 








u 


u 




(J 


:3 


'd 


H 


CJ 






d 


d 






0 




U) 


4J 








CU 


d 


lU 


0 


n 


O4 


4J 














•H 


> 


C» 


u 


w 












0 


d 


a 


d 






4J 








V 




U 


rJ 


ij 


u 






0 


CJ 


c 






0 


>i 


r* 


n 




m 




U 


rj 


0 


h 


a 


a 


:u 




•H 


u 


d 




w 




u 


4J 




0 


•H 


c 


r: 


n 


W) 


U 


4J 


a 


0 


CO 






f: 


H 


0 


13 




•H 


u 




4J 


•H 


•H 






O4 




\: 


u 






to 


<o 


—4 


•H 




CJ 




H 


CU 






4J 


4J 


0 


u 




0 


0 


CJ 


d 


Q4 


CJ 


u 


0 


H 


u 


4J 


4i 


«H 


•H 


aj 


.H 


n 


C 


u 


0 


d 


0 


0 




■H 




U.4 


J 


0 


0, 




r; 


ft 


(J 


1 




•H 


•H 


•H 


0, 




4J 


jj 


v< 


n 




•J 


0 




Vi 


fl4 








d 






4J 


V4 


)4 




0 


d 


ij 


m 


0 






V4 


c 


•H 






u 




1*4 


w 






04 


O4 




0 


Q 


w 




u 






P4 


H 




w 


0 





8G 



(Cont. ) 



CO 



u 

o 

o 



















0 








\i 






0) 


O4 


>Mi 


u 


M 


•H 






•H 




0 


















0 


H 



O 
H 



1; 





4J 












d 








0 




U 




J; 














u 


u 


0 






•H 


•H 


;c: 




0 






4J 










0 






0 


M 



d 

0 



0) 

m 



4J 

c 

a 



1^ 



to 








0) 








> 








•H 








4J 




0 




0 




ftJ 




(1) 




V4 








4J 




^ 




a 




0 




0 


H 






u 










4J 








0 


(14 


0 







01 

•H 

a 

rj 
to 

































■H 






















<D 




0 




4J 






U 




u 




£? 






•H 




cu 




C) 


n 




Q 


U 






i: 




(1) 




u 






u 






U 






•H 




■.^ 










:) 


0 


'4 < 












U 




0 


t: 


0 






Cm 


0 


r-1 





O 



ERIC 



}{7 



BEST COPY AVAILABLE 



Wij have s:cen that considerable similarity 
exists araonq the line item cost categories of 
several lab^.^ratorier. • Comparability ^ however, of 
cost treatment in terms o£ assignment of costs to 
categories is of equal importance. Differences 
are frequent, as the following illustrates. First, 
costs and expenses may be reported on the basis of 
cash flow or accrual. In many cases, the two treat- 
ment procedures are identical, as in the case of 
salaries. In other cases, the two are not identical, 
as in the case of staff vacation and sick leave 
benefits. TreaUed as a cash flow, these benofits 
are charged as taken . Treated on an accrua l basis, 
tlie costs of these benefits are charged as they are 
earned. In tl:e treatment of these benefits, one 
laboratory charges them on a cash flov; basis whereas 
other J.abs charge them on an accrual basis. 

The assignment of telephone charges provides 
another illustration. Here, RBS charges local and 
general (sv;i tchboard equipment, etc) charges on the 
basis of gross staff salaries; NWREL charges based 
on the number of telephones. Rent charges provide 
a final illustration. Here, FWL lab does not include 
a rental charge for its facilities under the rental 
category. Instead, these charges are included in 
the category of indirect costs, NWREL docs include 
rental charges for its facilities, as well as those 
for v/hich it contracts separately, in the rental, 
category, 

FV7L, NV7REL, and RBS allocate line item costs into 
development, operations, evaluation and replication. 
Chart III lists these categories as derived from 
the opera tic^nal plans of the laboratorie? and from 
materials gax;hered during visits to development sites. 

Chart III shows that NWREL includes additional 
categories, but it is easy to see how these relate to 
those found in systems FWL and RBS, The potential 
for definitional differences exist. FWL defines 
operations to be,., "all costs associated with the 
operation of the pilot EBCE program," This includes 
all costs for administration ins truction and gui- 
dance , resource maintenance , and student records , 
Administrate on includes facilities , equipment , trans-- 
porta I ion for s taf f and students , insurance , 
provision for health and safety, and for advisory 
boards. This definition differs from that of 
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operations found in RBS whoit.^ wg find that... 
"operations pc^^rforms tho foliowinq functions. •• 
intplomentat j on oL' field ton tiny; direct servicing 
of student needs; and identification of desicjn/ 
development deficiencies." The equivalence of 
these two definitions is not obvious, and in fact 
that of RBS iifiplies a greater probability that 
some evaluation and desicjn activity may qualify 
as operations in comparison to FVJL. 

None of the systems makes provision for collec- 
tion of the costs which are associated with the 
remaining research and development activities 
referred to in Chapter Three. 

The three laboratories whicli go beyond line 
item accounts also provide cost breakdowns beyond 
those shown in Cnart IV. These are displayed in 
Ch^trts IV, V, and VI. ^ 



Chart IV 
FVIL Reporting Catcgorj.es 
System Planning and Design 

Formative Evaluation 

Documentation 

Development 
Development of Learning Resources 

Formative Evaluation 

Documentation 

Development 
Development of Curriculum Organization 

Formative Evaluation 

Documentation 

Development 
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Development of Stuuont Related Procedure 

Formative Evaluation 

Documentation 

Development 
School Operations 

Research and (Summative) Evaluation 



Chart V 
NV/REL Chart of Accounts 
School Contract 

Dissemination 

Development 

- Governance 

- Manacjemcnt 

- Instructional System 

- Basic Skills 

- Life Skills 

- Careers 

- Guidance 

- Employer Utilization 
Operations 

Laboratory Contract 
Development 

- Governance 

- Management 

- Instructional Skills 

- Basic Skills 

- Life Skills 

- Career Development 

- Guidance 

- Employer Utilization 



Forma t i ve i: va 1 ua t ion 
General 
Governance 
Management 

Instructional Systems 
Basic Skills 
Life Skills 
Career Development 
Guidance 

Employer U ti 1 i Zci t ion 
EBCE Stabilization and Replication 
Sunmiative Evaluation 

General 

Governance 

Management 

Instructional Systems 
Basic Skills 
Life Skills 
Career Development 
Guidance 

Employer Utilization 
Product Development/Dissemination 
General 
Governance 

Management 

Instructional Systems 
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Basic Skills 
Life Skills 
Career Development 
Guidance 

Employer Utilisation 

Cost Installation Study - Milestone #1 

Replication Prospectus 

Program Administration 

September, 1973 - November, 1973 
December, 1973 - February, 1974 
March, 197 4 - May, 1974 

June, 1974 - August, 1974 

Chart VI 
RbS Chart of Accounts 
Program Administration 

Development 

Operations 

Evaluation 

Replication 

Other 
Evaluation 

Career Development 

Career Guidance 

Basic Skills 

Supplementary 

Other 
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Replication 

Career Uevclopment 
Career Guidance 
Basic Skills 
Supplementary 
Other 

Career Development Unit 

Career Exploration - Development 
Career Exploration -'Operations 
Career Specialization - Development 
Career Specialization - Operations 
Other Development 
Other Operations 

Career Guidance Unit 

Transition Program - Development 
Transition Program - Operations 
Personal Development Program - Development 
Personal Development Program - Operations 
Placement Programs - Development 
Placement Programs - Operations 
Other Development 
Other Operations 

Basic Skills Unit 
Development 
Operations; 
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Supplementary Program 



DGvelopmont 
Operations 

Several observations can be offered on the basis 
of these exhibitJ3 . First , beyond the categories 
noted in Chart III^ the accounts are quite differ- 
ent. Second, the additional categories tend to - 
describe the products of the development process 
rather than the components or products of the 
operational process. The former is commendable^ 
but the issue of adopter costs is not fully 
addressed. Specifically, costs of changes in pro- 
gram structure cannot be addressed. 



B. Cost Reporting at Model II Sites 

The several models require time reports by their 
staff. These are presently submitted monthly at 
one laboratory and bimonthly at the other throe. 
All report the percent or fraction of time devoted 
to each reported activity, and the base is the 
norm.al work period. The period of time which entry 
in the report covers also differs among laboratories. 
AEL requests a single statement of time allocation 
over the month, RBS over the bimonthly period as a 
whole, and NWKKL requests a report for each day of 
the reporting period. Charts VII and VIII illustrate 
two approaciies. 



III. Assessment of Model II Reporting Systems 

A, Reporting Categories 

It should be clear by now that the four EBCE 
laboratories exhibit differences v/ith respect to 
cost reporting categories and their definitions, the 
procedures which staff employ in time rcportings, 
the degree to wiiich non-personnel costs are direct 
costod, and tiie assignment formulas for indirect 
costs. Neither the laboratories nor NIE are unaware 
of these. 
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Chart VII 
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Chart VIII 



Career Devolopment Unit 



Staff Person - 



V04 Career Development Unit 
Cost Centers 



01 Career Exploration Development % 

02 Career Exploration Operations % 

03 Career Specialization Development % 

04 Career Specialization Operations % 

05 Other Development % 

06 Other Operations % 



What percentage of your time over the last pay period 
did you spend in the various codes? 



Please submit this form to ycur team leader on Tuesday 
prior to pay day. 



c , 



Chicacjo Meuting 



In October a inoctincj was held in Chicago to 
discuss cost-related issues. A copy of the agenda 
is included as Chart IX. The meetincj did not 
resolve the issues posed by the agenda. However, 
the following conclusions were drawn at the confer- 
ence • 

1. There was tentative agreement upon the following 
research and development categories for purposes 
of uniform reporting to NIE. 

a. Development 

b. Operations 
c • Evaluation 

d. Replication 

e. General Administration 

2. Of the above, a definition was agreed upon for 
Development as follows 2 All design, fabrication 
and revisions prerequisite to providing EBCK 
services to students. 

3. Operations was defined as follows; All activity 
and cost associated with the delivery and 
coordination of EbCE learning experiences to 
students. Based on the definitions a list of 
operational costs was developed. 

!• Enabling Costs 

A. Staff Selection 

B. Staff Training 

C . Student Selection 

D. Employer Recruitment 

E. Staff Setup and Supply 

F. Orientation 

II. Program Operation 

A . Administrative and Clerical 
li. Instructional Delivery System 

1 . Basic . Skills 

2. Life Skills 

3. Career Development 

4. Guidance 

III. Logistics (Transportation, Insurance, 
Health and Food Services) 

IV.' Major l'\ixed Costs 

A. Runt 

B. Capital Equipment Costs 
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Chart IX 



Agenda for KBCE Cost Conference 
Chicago, Illinois, October 11-12/ 1973 



Thursday, O ctober 11 

8:30 a*m» A. Feasibility of a Uniform Cost 

Allocation System for EBCE Sites 

-Discussion of current allocation 
practices (reference Fy '74 
Operating Plans) 

-Tentative decision on standard 
major cost categories 

-Difficult issues relating to cost 
allocation among major categories 
(representatives from each site 
should be prepared to raise questions 
v/hich v/ill help clarify how costs 
should be distributed among cost 
categories; e.g. should any of pro- 
ject director's salary be prorated 
to operations? How should start-up 
costs be defined? Ilow should rental 
costs be handled, parti.cularly when 
overhead staff and students use the 
same facility? 

-How should the cost information he 
collected and reported by the 
projects? 



12:00 - 1:30 p.m. LUNCH 

P.M. (Continuation of morning session as long 

as necessary) 

B. Determination of comparative cost-s 
in local LEAs 

-What npocific questions need to be 
an^sv/urou? 
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is the best process to get 
those ansv/ers (Separate contract 
amendment to each site? National 
RFP? Competition among four KBCE 
sites?) 

-Can the E13CE cost allocation formula 
be applied directly to public school 
operations to determine per pupil 
costs? VJill it need to be modified 
or expanded for this purpose? 



C. Cost Considerations in Replication 

-What will we need to tell prospective 
adopters regarding costs? 

-Are there special cost data needs 
for replication which require 
different analysis? 

-Is costing-out componentc feasible? 
desirable? 

D. Cost Effectiveness Issues 

-What are the cost effectiveness 
considerations v/e should be con- 
cerned about now? FY '75 beyond? 

-When should formal cost effective- 
ness studies be initiated? 

-Are there specific issues which are 
so importnat as to require special 
attention? 

-Longitudinal study considerations 
involving costs 



Friday; October 12 



8:30 a.m. 



(Continued Topic B if necessary) 



12:00 - 1:30 p.m. 



LUNCH 



1:30 - 3:00 p.m. 



Conference Wrap-up 



-Unresolved issues 
-Assignments 
-Good of the Order 



ADJOUKiviMENT BY 3:00 P.M. 
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4, The financial officers of the laboratories 
agreed that, although indirect costs were allo- 
cated differently rmong the labs, they could 
compute cost data by hand in order to satisfy 
uniform cost assignment requirements, 

5. Charts IV, V, and VI show that the category, 
operations, is less well detailed than those of 
development and evaluations. One conclusion 
reached by the conierencc participants was that 
operational costs should bo reported in greater 
detail and, if necessary, that detail in other 
cost categories r.hf^ald be reduced. 

Research and Developmient Cc i:egories 

Model II as a group should be able to provide data 
which describes uniform research and development activities 
to NIE. One laboratory in particular provides a speci- 
fication of the several phases of research and development 
activity by work units, or products. This is useful and 
relates costs to NIE milestones. We believe it is 
possible to do this with respect to the activities 
defined at Chicago as Development, Evaluation, and to 
some extent, depending on how it is defined. Replication. 
VJithin Operations, however, allocation of resources and 
cost to some products will be possible — for example, to 
governance and community resource utilization. 

Other products, such as basic skills, life skills, 
and career development, may be difficult to separate 
from one another and may have to be treated as one unit. 
This is a consequence of an explicit goal of EBCE pro- 
cess, that learning activities should be blended . Other 
activities cannot be directly assigned to EBCE products. 
General administration is one of these. 

The activities listed at Chicago do not conflict with 
the Standard Categories in Chapter Three. Their rela- 
tionship is indicated in Chart X on the following page. 

We belive thcit replacing the one category of general 
administration with four categories; that adding product 
finishing; and the replacing replication by documentation 
and diffusion v/ill provide a fuller description of cost 
to NIE. 
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Chart X 



Development 
Operations - 
Evaluation - 



Comparison of Model II and 
Recominendod Standard Categories 

Design 

Application 

Evaluation 



Replication 



General Administration — 



Product Finishing 
Documentation 
Diffusion 
f General Administration & Clerical 
Funder Negotiation & Liaison 
Site Negotiation & Liaison 
Staff Hiring and Orientation 



Service Dolivery 

Model II laboratories do not generally record data 
in a form which will be useful for estimating resource 
requirements and costs to potential adapters. The most 
useful in this regard is RBS which could break opera- 
tions down as follows: 

Chart XI 
RBS Operations Breakdown 

Operations 

Program Administration 
Career Development 
Career iSpecialization 
Tran5*iition Program 
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Personal Development 
Placement 
Basic Skills 
Supplementary Program 



However, we believe that estimation of program 
service delivery requirements should be based on the 
difforciHt and distinguishable services provided directly 
and indirectly to students. Chart XII based on Chart 
I is meant to be illustrative in this regard. It 
represents a useful, although tentative , beginning. In 
any case, operations requirements and costs should be 
broken down. In doing so, the categories must be 
constructed so as to be clearly distinguishable by 
reporting staff. 

No laboratory has indicated that estimation of 
service delivery requirements will emphasize resource 
requirements first and costs second. 

The collection of several categories of research 
and developnient activity into one, General Administration, 
as in Chart X may result in service delivery cost 
estimates v;hich are too lov; if General Administration 
is excluded and too high if General Administration is 
included. Only part of that category should be included 
in service delivery cost estimates . 



Chart XII 



Suggested Service Categories 



for Application/Operations 



A. 



Direct 



Services to Students 



1. 



Program 



Student Recruitment 



b. 



Initial Assessment and Invitation 



Orientation 



Diagnosis 
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Loncj-Rancje Planning 
£• Short-Rancje Planning 

g. Execution 

h. Progress Monitoring and Assessment 

i. (Placement, should it exist) 
2. Support 



a. 


Transportation 


b. 


Food Services 


c. 


Health Services 


d. 


Insurance 



B. Indirect Services to Students 
1. Program 

a. Experience Institution Recruitment 

b. Resource Site and Person Identification 
and Analysis 

c. Acquisition and Development of Learning 
Materials 

d. Learning Material Storage and Distribution 

e. Staff Recruitment, Orientation, Training 
and Professional Development 

. 2. Support and Fixed Costs 

a. General Administration 

Staff Time Reporting 

Model II laboratories use very dissimilar time 
reporting procedures* We believe that no serious 
problems would stand in the v/ay of uniform procedures. 
Uniformity v;ould eliminate differences in cost 
re[)orting duo to staff time reports. 
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Most laboratories report time over an exces- 
sively long period and in terms of percentages. 
Fur raVREIi, which does request daily re[)orting by 
staff (although whether staff so record their 
activity is open to question since reports are 
submitted bimonthly) , it appears that fractions of 
the day are the units of record. V7e, of course, 
believe that staff should record tlie actual hours 
devoted to various activities permitting use of an 
effective wage rate , and time reporting approxi- 
mately contemporaneous with activity performance. 
No Model II laboratory does this. 

Allocation of Indirect Costs 

As the Chicago meeting disclosed, Model il 
laboratories treat the assignment and allocation 
of non-personnel costs quite differently. This may 
be a consequence of each laboratory having to 
satisfy several fundors. It is also due to cost 
treatment conventions agreed upon by the particular 
agent of the government and the laboratory at the 
time of their initial relationship. The government 
will be represented by one of many agencies so that 
not all laboratories are necessarily accountable to 
the same one in formation of accounting conventions. 
Fortunately, the laboratories have expressed willing- 
ness to make special calculations in order to satisfy 
WIE desires for uniform accounting. 

Direct assignment of costs should precede further. 
Specifically, rent of facilities ov/ned by the labora- 
tory and associated utilities should be directly 
charged, as should employee benefits, instead of 
absorbing these costs into an indirect cost pool to be 
assigned on a prorated basis. No laboratory assigns 
a capital use charge for use of equipmcont previously 
purchased. Such equipment is charged on a cash flow 
basis. This is not a significant concern when reporting 
total program costs of research and development to 
NIE. It becomes an issue when separating total cost 
into its elements, v/hen estimating adopter requirements 
costs, and v/hen conducting cost/effective and cost/ 
benefit analysis. 

Wlien laboratories break down program costs into 
smaller activities, of which development is an 
example, there is no clear indication as to the costs 
which are unambiguously direct to the activity and 
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those which arc indirect. A reporting scheme 
which reports direct costs by category and indirect 
costs by category with footnotes to specify the 
particular cost pool of assignment and the pro- 
ration formula would be useful to recipients of the 
report. Also, since indirect costs are likely to 
be fixed over some range, their identification would 
aid an adopter reader in assessing the degree to 
which costs would change in response to changes in 
the particular program activity. 



IV. Summary 

In summary, we belive that Model II laboratories have 
in operation or are moving toward a structure of accounting 
categories for reporting research and development costs 
to NIE which are similar to, but will stop short of, 
that specified in Chapter Three. In our opinion, more 
detail should be obtained in the area of costs which are 
not direct to any particular research and development 
activity or product* 

At present, the laboratories have little ability to 
estimate operational requirements or cost beyond the 
simple total operational ccst component of their report 
system. This is not a serious problem, since as men- 
tioned elsev/here the operational resources and costs of 
program operations are expressed in terms of cost per 
month. That is, if the proper categories and procedures 
are established in the near future, the basis for des- 
cribing operating costs of program operations can be 
estabJ.ished and applied in time to obtain operating 
cost measures. The same applies for acquisition costs 
if a full field test of EBCE programs takes place in new 
settings. 

Operational activity needs to be defined in terms 
of its production process, and, if possible, its output 
results. 

V7e found that most interest in the area of adopter 
service delivery centers on costs rather than physical 
rcbuurce requirements. V/c have emphasized in Chapter Four 
that for purpose:-; of adopter estimation of cost, it would 
be for more useful to focus primarily upon specification 
of resource requirements cind upon costs secondarily. This 
is due to the difference in resource prices , resource 
availabilities, and accounting practices among potential 
adopters . 



1. However, since the level of activity and, therefore, 
cofiL f luctuatcis among program coiiiponents throughout 
the year, it preferable to have a full year of 
measurement. , 



We believe that for many IIougI II laboratories, the 
direct costincj of resources should proceed further, 
at least in tiiu c:m\li uf laeiliti.us. Further, rej.iorts 
should make clear wliieh charcjet.; are direct to the cost 
category under study (e.g., evaluation) and which are 
indirect. The allocation procedure for indirect costs 
should be noted. 

I7hen reporting physical resource requirements a 
parallel procedure sliould be followed. The ratios of 
resource requirements should be clearly specified. For 
example, if one learning coordinator is necessary for 50 
studuntb, thcit should be clearly stated. 

More than any other NIE career education model, EBCE 
requires the allocati.on of resources external to its 
payments system. Meaningful implemientation of EECE 
requires placuiuent of significant number of students at 
public and private institutions which are to perform 
significant educational duties. This practice is bound 
to impose significant costs upon these institutions. 
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Chapter Six 
UESCRTPTION AND ASSESSMENT OF MODEL III 



INPOiy^lATION SYSTEM 



(Telephone Counseling Career Education^ EDC^ Providences R.I.) 



I, Program Description 

Model III provides career counseling to those 
members of the population v;ho are potential members 
of the labor force . Stated negatively ^ if an individual 
is actively engaged in v;ork, seeking work, training 
for works or under age 16, then that person is not a 
member of the target population, or market, for the 
services of this project. One objective of the program 
is to encourage individuals to consider entering the 
labor force and to facilitate that entry by means short 
of providing placement and/or training services. 

The second objective of the program is to accomplish 
the above through definite means. Specifically, 

1. individuals are contacted and invited to parti- 
cipate through printed and broadcast advertising ^ 

2. counseling services are to be provided through 
scheduled telephone sessions and 

3. the telphone counselors are to be para- 
professionals . 

The process will be described briefly. Individuals 
are contacted through advertisements v;hich solicit their 
interest in career covins cling and request that they phone 
the program to receive services. Upon calling^ the 
respondent is given an initial interview (over the phone) 
wl'iich collects basic information for the purpose of 
introduction, screening, conducting advertising research, 
and scheduling into the program. A phone call between 
a counselor and the respondent is scheduled for the 
third following working day. From that point, additional 
contacts are scheduled betv;een the respondent and the 
counselor. The period betv;een sessions is used by the 
counselor and/or the respondent to accomplish tasks 
necessary for the career guidance procedure to progress. 
The counnolor may need to obtain additional information 
(e.g., finance sources, training arjoncios) , or the 
respondent may be assigned the task of reading career 
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matorials in a given area, of contactinq other agencies 
offerinq Lraininq, nlacemont, or other career related 
services in the comnunityt The process continues until 
the respondent (1) enrolls in a preparation program, 
(2) concludes no i^roparation is a})pronriate and initiates 
job search, (3) terminates on his own and states why, 
or (4) becomes impossible to contact further • Respon- 
dents who either enroll in training, (1), or initiate a 
job search, (2) , are contacted after two weeks and then 
again after two more weeks in order to check on progress; 
this is follow-up activity. This process is elaborated 
in Chart I, Model III Organization and Process. In the 
chart (c) indicates client movement, @ indicates 
materials movement and (e) indicates external resources 
movement. 

One can see that the primary point of direct con- 
tact between the client and the program is the coun- 
selor. This direct contact is supported by (1) a 
resource center consisting of career materials for 
reference of the counselor, other staff, and very in- 
frequently by respondents, (2) an information unit whose 
task is to produce readily usable materials for coun- 
selor use, (3) an outreach unit whose function is to 
create the advertising messages which bring the potent- 
ial training and placement agencies and promotes dif- 
fusion of the Model III career education program 
itself, and (5) an administrative unit. Also present, 
due largely to research and development rcquircrricnts 
rather than to operational requirements, is a research 
unit and a set of consultants. Thus the program is 
organized into the following units: 

a. Outreach Component 

h. Counseling Component 

c. Information Unit 

d. Resource Center 

e. Institutional Development 

f. Research Component 

g . Management 

II ♦ Description of Accounting System 

The EDC general accounting system collects and 
provides cost data on the basis of the above components . 
The pro j oct sunp lemon ts that information by collecting 
cost data according to subcomponents. For example, 
the counseling component contains the follov/ing sub- 
components : 

a . On-phone , home based , 

b. Of f-nh.ono , homo l)ariOd , 

c. 'J'rainmg (of staff) , 
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d. On and off-phone, non-home, based, 

e. Supervision 

f. Otlicr 

q. Vacation 

h. Holiday 

i. Sick 

The comnoncnts and their subcomponents are indicated 
by Charts II-VTI, IIov/ are various costs treated with 
respect to these categories? 

Personnel Resource Allocation and Cost: All stajf 
fill out the time slieets displayed in Charts II-VII. 
Reporting is to occur daily with reports submitted weekly 
All staff report total hours broken down into sub- 
component categories to the nearest half hour. Hourly 
paid staff, however, must complete the report so that 
the number of hours sum to a given total. The records 
at I:nc-Career Education retain the time allocation 
to component and subcomponent • 

Dollar value is assigned to the physical allocations 
of time through an effective wage rate (equal to salary 
divided by total hours for salaried staff and through 
the actual hourly pay rate for non-salaried staff.) 
Vacation and sick leave time is accrued at a given rate 
and assigned proportionately to the distribution of total 
time . 

Consultants c i^.rgcs are assigned to the component 
and sub-com.ponent co which their v/ork relates. 

Most non-personnel resource allocations and costs 
are assigned to the administrative component. This 

is true for rent and maintenance. Utilities, ^1.1 
telephone, except counseling v/hich has its own system, 
and any equipment charges. Transportation of Persons 
and Vr.r Diem is charged to the component and sub- 
component to which the associated staff time is charged. 



1. There is no time sheet for the Information Component. 
This component was, however, in the process of being 
established (pulled out of Resource Center) at the 
time of ARIKS* vi.sit and a siioet for this componert 
presumably exists at prenent. 
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Chart VI 
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III. AssGGsmcnt of the System 

As a preface to this section, it should be noted 
that MDC is continuing to develop and improve its 
accountinq system. The alcove description and the 
remarks which follow are based on the system as it was 
in late October^ 1973. Modifications are presently 
underv/ay . 

The cost categories do not lend themselves neatly 
to describing research and development costs to NIE. 
There is little that can be associated with the activity 
categories of Chapter Three. The only exception is 
the research component and allocations made to it from 
consultant costs. Here tho assumption must be made 
that no non-evaluation activities are performed by 
staff in that unit. It is similarly not clear hov; the 
activities of the remaining components relate to evalu- 
ation and the other activities in Chapter Three, It 
would be possible to make appropriate . allocations 
based on judgmental assessment of the primary thrust 
of subcomponent tasks. For example, it is tempting 
to classify the activity of the - information unit as 
"Design" and that of the counseling unit as "Applica- 
tion" . The application of the categories of Chapter 
Three and the matrices of Chapter Four would at least 
encourage an effort to allocate component tasks among 
research and development activities (e.g. , the in- 
stitutional development unit performs some duties which 
relate to "application" and others which relate to 
"diffusion".! 

The primary concern of EDC has been v/ith record- 
ing activity, resource allocations, and cost for the 
purpose of assisting potential adopters. The compon- 
ents and subcomponents have been designed v;ith that 
in mind. One can see the relationship as described in 
Chart 1. 



1. V7e do not wish to imply expert knowledge in this 
regard. To verify these relations would require 
an intensity of analysis that goes beyond this 
study. We do feel that the relationship as shown 
arc generally true and are those implied by the 
component structure given by EDC. 
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This cluirt dis-^plays l:)Oth the component units, other 
than consultcints v;hich have boon assiqncd to those com- 
ponents that aro displayed, and the sorvi cor> rendered 
by the respective component as understood l^y ARIES. 
While the sul>co:::p(:Miont:; used by Wl^C do not fully fit 
those implied by Chart I, one can see that EDC cate-- 
gorios arc already structured along the line of those 
required for estimation of service delivery costs. 
The time i^-^porting documents are tailored for the 
general assignments of staff in each component. VJhen 
a person in one component area works for the benefit 
of another component area, he charges the second com- 
ponent area directly , logging his time according to 
the appropriate subcomponent of tliat component. The 
form make provif^ion for "other" activity to record 
time in general meetings and otho.r non-specified 
activities. ZaIso, since the system retains the physical 
allocation of oersonnel resources, KDC is well along 
the v;ay to being able to specify physical require- 
ments in the way of staff person hours, space, equip- 
ment and facilities to operate a given activity. 

The nature of EDC operations means that client data 
exists. That is. the number of clients in the program 
at any time, the number who enter and leave, the length 
of stay and number of "treatments" (or phone sessions) 
can be made available. Cincc estimates of adopter 
resource and cost requirements start with the operational 
lev^il (client load) or output goals (number of clients 
v;ho enter training or job search) , the elements of 
service delivery cost are there. 

Only tv;o weaknesses remain. First, almost all non- 
personnel requirements (e.g., rent, utilities, non- 
counseling phone) are assigned to administration. It 
is not possible at present to assign them to components. 
Ilov;evor, doing so in the future involves only (a) 
direct measurer^ient v;hero possible (e.g. , square foot 
assignment to each component and/or (b) proration based 
on the nosr sensible burden rate. Also, it is not clear 
that physical units are retained, although since pur- 
chase orders and bills for service exists one may hope 



1. EbC indicates it would be possj.ble to assign direct 
activity cost codes per ARIES design (i.e./ product 
design, etc.) to each I'IDC component (unit) to 
generate tlio desired data. The Project is completing 
a cost :;tiid\' for MTi; which uses somowh.at similar 
designations for costs since May, 1972. 
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that a.sr.icininontfi can bo made on tho basis of physical 
quantities. Ilowovor, EDC is av;aro of this and is movinq 
to tracl; and allocate divisablc resources, such as space, 
and to aliocnto indivisible resources, such as admini- 
strative service . 

The second v;eakness is the absence of research and 
development activities, as noted. Recall that in Chapter 
Four, Bee tier. I v.'o recommended tb^^ estimat.inn be based 
on upper and lov/er limits. Therefore estimation on that 
basis could not be made unless the EDC components were 
also cost coded as mentioned above. 
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ChciptGr Seven 



DFSCRTPTTON AND ASSESSMENT OF MQDKL IV 
INFORMATION SYSTEM 



(Residential, Family Based Career Educcition Program, 

MPEEDC, Glasgov;, Mont.) 



I. Program Description 

Model IV provides career education services to 
residents of the six state area of Montana, Nebraska, 
Wyoming, North Dakota, South Dakota, and Idaho who are 
under or unemployed and roughly at povery level in- 
comes. These are general criteria, and Mountain Plains 
imposes other criteria as well. If these are met, the 
family unit is accepted. 

Model IV is residence based — the families are 
moved to Glasgow Air Force r;ase — and, in principle • 
family focused. Services are provided to Die entire 
family as v;oll as to the member (s) of the family under- 
going training. In one program Mountain Plains offers 
services v;hich are available separately and disjointedly 
under existing programs such as AFDC , WIN, MDTA, etc. 

The objective at Model IV is to raise the employ- 
ment level in terms of income, potential for job 
advancement, and personal development of the family. 
Success means placement in em.nloyment with some ex- 
pectation of permanence or placement in advanced train- 
ing. 

Since Mountain Plains provides, in a unified system 
and in a residential setting , those services which other 
programs provide separately, it is at one time the most-^ 
traditiona]. (that is, it i^s a training program with 
employment objectives) and most complex of the career 
education projects (that is, in the breadth of services). 
It is possible to provide a list which categorizes the 
services offered by Mountain Plains. 



1. This separation is both institutional and geographic. 
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Chart I 

Mountain Plains Component Services 



A. Conimunity Services 

Medical, Dental, Education; Day Care, Housing, 
RecredLion 

B. Family Services 

Personal Counseling, Home Management Skills, etc. 

C. Individual Services 

Personal Counseling, Employment Counseling, 
Training (Occupational Preparation) , Job Seek- 
ing and Retention Skills, Placement 

D. Support .Services 

Administrative; Recruitment, Screening, and 
Selection; Follow-up 

We will briefly sketch the process. Potential 
students are recruited through selection offices located 
in the several states. If the family meets Mountain 
Plains requirements, they are accepted. The family 
then moves to Mountain Plains, where a community 
instructor is assigned und a brief period of time is 
allowed for the f ami ly to move in and adjust . Follow- 
ing that, a short orientation takes place, which famil- 
iarizes the family life with the program, collects 
initial information through testing and interview, and 
fulfills logistical requirements. After orientation, all 
adult members of the program participate in a four v;eek 
core curriculum and begin mandatory counselin g and career 
guidance . The core curriculum emphasizes lipme skills 
(e.g., budget management, credit, house care). Counsel- 
ing has responsibility for personal (e.g. self esteem) 
and non-employment interpersonal (e.g., marital relations) 
problems. Problems related to career choice, training, 
employment, and }:)lacement are the province of career 
guidance. Upon completion of the core curriculum, 
the head of household is to be sufficiently along in 
career development so that occupational prepc^ration 
can becjin. This activity may commence at or beyond 
the point of developing those basic skills which are 
necessary for successful employment. 

The other adult member of the household must make 
a dc^cision at the completion of the core curriculum. 
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The throe options open to this person are (1) to enroll 
in occupational preparation, (2) to enroll in home- 
makor (production) program, (3) to enroll in no further 
programs . 

Also at the completion of the core curriculum, both 
adult family members continue in counseling. 

As their training ncars completion, students in 
occupational preparation enter a v;ork experience 
component which is actual employment in the area of 
training. The purpose is to evaluate the effect of _ the 
student development services received up to this point. 

Near the conpletion of training and v;ork experience, 
the person participates in placement skills develop- 
ment and actual placement efforts on his or her behalf 
begin. After the student is placed, f ollow-un and 
f oilovz-throucrh services are maintained and, Tn principle, 
families may continue to receive some services to aid 
them in adjustment to their new environment. If the 
placemicnt proves unsatisfactory, additional placement 
efforts are provided. 

The process is illustrated in Chart II. It must be 
remembered that the entire family is present at Mountain 
Plains and that norm.al personal and community services 
(e.g., health, dental, education and child care, and 
recreational) are being provided throughout the process 
described above. 

Mountain Plains organizational units are described 
in the following outline. 

A. Governance 



1. Board of Directors 
B. Administration 

1. Director, Assistant Director, and Controller 

2. Administrative Services 



b. 



a . 



c . 



Personnel 

Facilities, Property, and Purchasing 
Reprographic Services 



C. 



Education Services 



1. 



Foundation Education 



Occupational Preparation 
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D. Support and Field Services 
!• Placements 

2, State Offices 

3, ' Child Development 

4, Counr^eling Services 

5, Career Guidance 

E, Research Services 

Unlike Model III organizational groupings, staff in 
many of these areas participate in more than one of the 
component servicer-i shown in Chart II. For example^ 
caror^r guidance staff are associated with clients in the 
orientation, occupational preparation, work experience, 
placement skills and placement components of the program. 



II. Description of the Accounting System 
A. Reporting Categories 

The Mountain Plains system begins with the line 
item categories as shown on Chart III. Mountain 
Plains then makes explicit provision for the allo- 
cation of line item costs to research and develop- 
ment and operations. Their definitions are as shown 
in Chart IV. Thirdly, eleven functions are defined 
by Mountain Plains • These are: 



1. 


Instruction 


2, 


Administration 


3. 


Counseling and Cormnunity Development 


4, 


Career Guidance 


5. 


Child and Parent Development 


6, 


Recruitment 


7, 


Placement 


8. 


Sick Leave Paid 


9. 


Vacation Paid 


10. 


Holiday Paid 


11. 


Approved Unpaid Luavc 
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Chart III 



MOUNTAIN-PLMNM 
ECONOMIC DEVKh^ 

CHART OK ACCOUNTS 

SALAUi r.r> A::n ivji>:vr::3:> ; 
Salaries 

Sick cind lljncrqcncy Leave 
Paid Vacation 
Paid Holiday 
F.I.C.A. 

Morale and V/olfaro 
Retirement 

V/orkmen's Corr.pensation 

Unemployment 

Medical- Life Insurance 

TOTAL Salaries and Burdens 

TllATNRK ALLOTMrNTS ! 

Trainee Allotment 

Early Childhood Assistance 

FACT LI Tins 

Rearrangement Cost 

Building and Ground Maintenance 

Utilities 



EDUCATIONAL AND 
iPMKNT PROGRAM 

LINiVTYPC EXPANSES 



NKWff OLD# 

01 04,05,06,08,09 

, 08 20 

09 22 

10 21 

14 41 

15 42 

16 43 

17 44 

18 45 

19 46 

21 31 

22 33 

31 53 

32 54 

33 55 
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Chart III 
(Cont. ) 

< • . • • • 

Rental 34 5^ 

Joint Usage 35 5^ 
TOTAL Facilities 

INr.TRUCTIO::AL ruPPLIES AND MATERIALS ; 

Instructional Supplies '37 gl 

Instructional Publications 

and Printing 39 g2 

Other 39 g3 
TOTAL Instructional Supplies and Maintenance 

EQUIPMEMT ; 

Trainee Equipment 4X yj^ 

Staff Equipment 42 72 

Equipment Rental 43 12I 

Equipment Maintenance - 44 • • 122 
TOTAL Equipment Costs 

SUn-CONTPJVCTS A!:D PROFESniONAL FEES ; 

Consultants 45 

Data Services 47 ^2 

Other Sub-Contracts 49 

Outreach 49 

TOTAL Sub-Contracts and Professional Fees 



83 
88 



TRAVET, ! 

Airplane 51 
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Chart III 
(Cont. ) 



TITLE NKWi OI.Dj 
TRAVEL CONTTMUnp ; 

Auto 52 92 

Per Diem 53 93 

Other 54 94 
TOTAL Travel 

VEHICLE EXPENSE ; 

Vehicle Rental 56 101 

Vehicle Operation Expense 57 102 
TOTAL VEHICLE COSTS 

R ELOCATTON ; HI 

SUPPI.TE5 a:;d materials ; 

Office 61 131 

t 

Postage 62 132 

Reproduction 63 133 

Other 64 134 
TOTAL Supplies and Materials 

TELEPHONE AND TELEGRAPH ; 66 141 

MAGAZINE AND FUBSCRIPTJONS ; 71 151 

CONFERENCE AND ME M nERSHTPS ; 74 161 

FREIGHT ; 77 171 
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Chart III 
(Cont. ) 



• r • "TITLE NEW II OLDS 
INSURANCK ATiD MFDTCAT, COSTS ; 

Insurance 81 

Participant Medical Costs 82 182 
TOTAL Insurance and Medical Costs 

TAXES ANP LTCI'NSKS ; 85 191 

INVKtJTORY ADJUSTMEN'T ; ^ 88 201 

RECRUITMDN'T : 91 2IO 
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CHART IV 



Mountain Plains Definitions 

Operations ; 

Those activities which VN'ould bo necessary to continue 
the operation of the Model IV program in a fully develop- 
ed, stable mode. This includes pre-testing and post-testing 
tor purposes ot diagnosis and validation. It includes pre- 
paration for regular participant related activities, the 
activities themselves, and other directly related paper- 
work such as scoring tests and reporting participant pro- 
r* G s s • 

R&D ; 

Those activities necessary to develop, stabilize, 
and tost the Model IV program. This includes the de- 
finition, desiqn, creation, and redesign of program 
ob]octives; the development of programs and materials 
including curriculum; and the develonment of procedures 
Also included is the design of evaluation; the collection 
Of data for research purposes; the preparation of form- 
ative evaluation reports and responses to these reports; 
and all documentation of the plans, discoveries, progress 
and products of the program. 

Administration ; 

Management of operations and R&D efforts. This 
function is performed by state office staff, senior 
instructors and other supervisors. It includes community 
relations, procedural administration and reporting, the 
supervision of staff, the projection of resource needs, 
the provision of resources, decision making to support 
these processes, and exploration and communication in 
support of these processes. 

Adminis tration Related to Ope rations ; Administration 
of those activities which would be necessary to con- 
tinue the operation of the Model IV program in a 
fully developed, stable mode. 

A cl ministra Uo n Rnlatod to R & D ; Administration of 
those act ! V.1 ties necessary to develop, stabilize, and 
test the Model IV program. 
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Finally, a larqo number of cost centers are defined. 
These cire displayed in Chart V. 

* 

We have then three dimensions of resource and cost 
allocation: (1) T/ino Items, (2) Research and Develop- 
ment/Operations, and (3) Treatment Services • We shall 
want to describe the methods by which the values of 
resources and costs in the line item dimension are 
transformed into the other two dimensions. The method 
for so doing is based on either a measurement and re- 
cording system (direct allocation) or a system of 
arbitrary proration (indirect allocation) . We now turn 
to a description of the direct reporting system. 

B. Cost Reporting at f^ountain Plains Staff Time (and Cost ) 
1 < Q p c:) r t i nq System 

The heart of the resources and cost system is, 
as v;as stated in Chapter Three, the time reporting 
system. This is so since it is from personnel time 
reports that personnel gross salaries are computed 
and it is on the basis of either personnel, time or 
the associated gross salaries that most indirect 
allocations are made. 

At Mountain Plains, staff report their tim.e in 
terms of actual hours v/orked. Activity is reported 
daily and time sheets are submitted on a bimonthly 
basis. Chart VI is illustrative. The four hour 
entry displayed indicates a charge to cost center 127, 
or drafting on the 8th of the month. The "1" enter- 
ed under the R&D column indicates that activity 
was employed in the research and/or development 
and that the function was that of -instruction. Staff 
may charge to any cost center and function based on 
the content of their activity. 

Those individuals who are executive officers or 
who are employed in either the controller * s office 
or administrative servi ces report their time as O/II 
(overhead) unless they make a recurring, large, allo- 
cation to some one of the eleven functions. 
Non Personnel Reporting , Materials , supplies and 
ecjuipment are recorded in a manner v;hich assigns 
them ultimately to a cost center in terms of both 
physical quantity and cost. Chart VII shov;s the 
recording document used at Mountain Plains. 
Non Staff Sc^'vicos Roporhinq . Allocations of service 
and cost are assigned directly to the using cost 
center. It must be possible to provide physical 
units based on iDilling invoices submitted to Mountain 
Pla Ins . 
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Chart V 



MOUNTAlN-n.Mr.'S EDUCATION & I-CONOMIC 
DEVELOPHKNT PHOGllAM, INC. 

COST CENTEKS 

ADMINISTRATIVE OVERHEAD 

TITLE ' 

EXECUTIVE DIVISION: 

Executive Staff 
Board of Directors 
Controller-Accounting 
Data Center 

ADMINISTr<ATIVE SERVICES: 

Division Support 
Personnel Services 
Property Control & Purchasing 
Facilities & Maintenance 
Reprographics Services 
Multi-Media 
Program Support 



NEWS 



OLDf 



101 
102 
105 
106 



7510 

7550 
7550 



111 
112 
113 
114 
115 
116 
117 



7610 
7630 
7640 
7670 
7650 
7650 
7680 
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Chart V 
(Cont. ) 



TITLK 




■ OLD! 


EDUCATION SERVICES: 






Division Support 


120 


4110 


Occupational Proparation- 
Dcpartmcnt Support 


121 • 


4130 


Building and Trades 


122 


4410 


House rund 

Plumbinq, HcaLina, sheet 
Metal, Rof riacraV j (.in 
Building Construction & 
MaintcrK.,.ce 

Klcc tr or, ics- Electricity 
Drafting 


123 

124 

125 
12G 
127 




Automotive and Small Engines 


128 


4150 


Support Welding 
Automotive 
Small Kngines 


129 
130 
131 




Office Education 


132 


4420 


Marketing and Distribution 


133 




Food & Lodging 


134 


4140, 


Guest House 
Lodging Program 
Food Services 


135 
136 
137 




Social And Educational Services 


138 


4440 


Foundation Education-Department Support 


141 




Math Skills 


142 


4510, 


Communication Skills 


143 


4!j40 


Homo Skills Education 


144 


5205 


Health Education 


145 


5303 
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Chart V 
(Cont. ) 



TITLE 



KKV7S 



SUPPORT SERVICES- (GLASGOIO 

Division Support 

Caxeer Guidance 

Career Dcvelopmont 
Work Experience 

Counseling 

PerGonal Counsel inq 
Community Instruction 
Conununity Recreation 

Child Dcvelopnont 

Infant Day Care 
Nursery I'ronram 
Kindorqnr ton 
Parent Effectiveness 



151 

152 

153 
154 

155 

156 
157 
158 

159 

160 
161 
162 
163 



7810 

4740 

4740 
4750 

5005 

5005 
5005 
5105 



5410 
5420 
5430 



SUPPORT SERVICES (SIX STATE) 

Montana 

North Dakota 

South Dakota 

Nebraska 

Wyoming 

Idaho 

RESEARCH SERVICES: 

Division Support 
Systeinr, Level Konoarch 
Intra-Proqram Resecirch 
Curriculum 

DIRECT TRAINEE! 
SERVICE STATION 



171 
172 
173 
174 
175 
176 



181 
102 
183 
184 

190 

200 



7820 
7830 
7B40 
7850 
7860 
7870 



8510 
8520 
8530 
8560 

7010 

8720 
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Chart Vil 




^Uunliiii'Vitiiits t'JuMticii ^ t\\wati£ i)adi.<pi:i(itt /Viy.'am. }itc, ISSUE D C) C U M T N T 

S N9 3102 



3-26-73 


ACC0Ur4TlNG COOC TO. 

7550-131 


ISSUED TO: 

ACCOUNTING 




JAN UAlt) 

3085--9 


ACCOUNTING CODE FROM: 

1110 


ISSULOFHOM: 

PROEPRTY CONTROL STORES 


ITEM 


PART OH STUCK NO OCSCRlPTlON (Dctjjli'd) 


UNIT 

IS'JUC 


QUA.WTITV 


UMT 
COST 


EXT 

ccjr 


\ 


7530-222-3453 TAPE, PAPER 
STORES STOCK REQ. NO. NONE 

• 

• 


RO 


10 


.09 


.90 

i 


TOTAL COST .90 


ISSiJCO BY; 

1 


POSTED BY: 


AECEIVCCj QY; 


DATC: 
>J6J 


OATC: 


DATE: 



i 
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Stiul ont Tlmo Reporting at Mountain Plai ns • M o u n t c\ 1 n 
Plains also records the input of student time into 
various categories of activity. The allocation is 
part of the time card displayed in Chart VIII. 

The specification of the activities which will 
comprise the terms of report is undergoing re- 
fi.nement at the time of this report. The terms are 
developing along the same 1 ines as speci f ication of 
the service elements of the production processes as 
displayed in Chart I, or their subelements, 

^ • Assignment of Line Item Resources and Costs to 
Funct ion^ to Research and Devo]ooment and 
Operations Activities, and Service Elements 

In this section we give a summary des- 
cription of the allocation of various line 
item resources and costs into other dimen- 
sions. We shall take the items in groupings 
according to sim.ilarity of their pharacter 
and method of assignment • For each of these 
we will discuss the flow of assignment from 
line item to cost center to research and 
development or operations activities and 
functions. Subsequently we will describe the 
assignment flow to program service elements. 

Group A 

( Staff Salaries and Time ) T^hrough time reporting, staff 
services and time are assigned directly to cost centers 
(See Chart VI). Based on time and knovm salary, an 
effective v;age is computed and is the mechanism for 
assigning cost. The assignment from cost centers to 
functions and to research and development or operations 
is direct for all cost centers other than those of the 
executive division, the administrative services division, 
and direct trainee (services). The assignment of time to 
the cost centers of the executive and administrative 
services division is primarily that of overhead and is 
assigned i ndirectly to the functions and to the research 
and dcvelonment and operations activities on the basis of 
the following ratio: 

Total gross salaries allocated to the 
iill cost center, the jth function, and 
the kth research and development or 
operation activity for all L staff 
members 

---- f 

Total of All Cross Salaries ]]xclu5;ive 
of thor:n })ajd to I^xecutive and Adinini*- 
strative Divisions 
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n 

1=1 



n 2^ 11 -200 

1=1 K-1 j=l i-120 

•S 

T 

v;here w indicates the effective wage and t indicates the 
time allocation. 

Letting (O/II)^ indicate the dollar salary charges to 
overhead (or(0/H)^^ the disaggregated physical elements 
of those charges) then the assignment of (0/H)^ to the 
respective corabination of cost center, function, and 
research and development or operations, (0Hj^4j^)f is 
given by 

OH = (Ri^)^) (OH)^ 
i jk 

This ratio, '^^A-^t is frequently used as the basis where- 
upon direct charges are assigned. 

GROUP B 

( Sick and Fmoraency Leave, Paid Vacation, Paid Holiday , 
F.I.C./u, gnu !'.ot iro-.-^Gnt ) . These arc determined on an 
accrual basis for each individual . Then they are allocat- 
ed to cost centers, functions, and research and develop- 
ment or operations activities in the same proportion 
that time reported to each of such categories is of total 
time, 

GROUP C 

(Morale and VJelfaro, Unoinnlovmc -nt , and Medical-Life 
In s ur ariCf ) . 'i'huso urn as signed cfirectly to Administrative 
J^c'i-vicor; as 0/iI and assigned indirectly to other divisions 
on the basis of R- -i, . 
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Chart VIII 
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GROUP D 



( Tralnoo A1. 1 otmont.s and Ear.1v Childhood Assistance ) . 
These are assigned to Direct Trainee Services. These 
are not as-.niancd further Lo funct ionn and research and 
development or operations activities. Trainee allotments 
are paid on the basis of student time card reports of 
participation. 

GROUP E 

(Facilities ) . These items may refer either to resources 
and costs associated with student housing and support 
services or to Mountain Plains administrative, training, 
treatment facilities. Resources and costs associated 
witli housing, etc. , are assigned directly to Cost Center 
190, Direct Student Services and not further. Resources 
and costs not so assigned are assigned as O/Il directly to 
Administrative Services and indirectly to research and 
development or operations and to functions on the basis 
of R. 

GROUP F 

( Instructional Supplies and Materials; Trainee Equipment ) . 
This is assigned directly to the using cost center. if 
that is Direct Trainee Services, no further allocation 
is made. If any other c-st center, it is assigned to 
research and develop-nont or operations activities or to 
functions based on the ratio Rj^jj^ which has the same in- 
terpretation as R-Lj]^^ except that the summation is re- 
stricted to totals within the cost center. 

GROUP G 

( Staff ^ Equipment ) . This is assigned directly to 
the using cost center. For that assigned to Executive 
and Administrative Services, the assignment to research 
and development or operations will be' based on R. . 
Within other cost centers the assignment is base^-^on 



GROUP H 

(F.quipmont Rental, Equipment ^' .aintenance ) . See Group C. 
GROUP I 

( Sul)contrncts and I'rof essional Foes; Travel ) . See Group G. 
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GROUP J 

(V ohiclo Exnonsor I-o oat_icn) . Expenses in this cate- 
gory ai-o ar.siqiiod dirootly to O/II through Administrative 
Services or to nirt^ct Trainee Servicer. (1^)0). If 190, 
no further ansianncMit in made. It the direct assignment 
is to Administrative Services', the further assignment is 
indirect and based on R. ., 

GROUP K 

ISupp 1 i OS n nd ^!a tcr ia Is ). Charges to this object area 

are assigned direct J.y to Administrative Services. Further 

allocation is made on the basis of R. . 

13k 

GROUP L 

(Telephone and Tolearanh) . For long distance, logs are 
maintained and cost is charged directly to the cost center. 
Further assignments to functions and to research and 
development or operations are also direct. General 
services are transformed into a charge per phone a?id 
assigned to the cost centers. Further allocation is 
identical to Group G. 



GROUP M 



( Magazines and Subscriptions, Conference and >^emborshi p , 
Freici ht, rcx nc:- a;id .•^■dical Co.s ts, Taxes and Licen ses , 

Inventory Aci j us tp.ent , anct Hecru i.t.ment See Group J." 

Assignment to Program Services 

Mountain Plains is interested in assigning costs to 
program services (e.g., see Chart I). Present plan s 
are to do so on the basis of student time allocations as 
reported in their time cards (Chart VIII). 

Let A = Total Staff Dollars 

Let B = Total Staff Dollars to R & D 

Then C = A - B 

= Total Staff Dollars to Operations. 

Let D^ = T^tal student hours in each component 

Then D = Di 
i = l 



= Total student hours in all components. 
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The allocation of staff dollars to each of the I 
programs services is given by, 

sf = (''i ) c. 

D 

other costs (non-personnel) follow since they are based 
on gross salary dollars with the exception of Direct 
Trainee Services, for which allocation to individual 
services is inappropriate. 



III. Assessment of Mountain Plains 
Cost Accounting System 

A. Categories 

Research and Development . Mountain Plains makes 
explicit provision for classification of activity and 
cost into research and development and operations. 
Administration has three classifications, two ex- 
plicit and one implied: research and development, 
operations, and general. 

The basic point to be made about the distinction 
between research and development and operations is 
that it tiepends upon staff member perception. When 
reporting, the individual must decide whether or not 
the actwity "v.'ould be necessary in order to continue 
the operation of Model IV in a fully developed, stable 
mode." In many instances, this is not likely to be 
known . One must speculate as to what would happen 
rather than rcDort what is being done at the time. 
In our opinion this may lead to frustration when 
staff take the report seriously, to capricious 
reporting should they not, and to the development 
of arbitrary administrative rules for classification 
in leaction. Where there is an organizational objective 
associated with cost reports (e.g., minimizing oper- 
ational cost per student) , administrative rules may 
be made to produce the desired result (e.g., when in 
doubt, charge to research and development) . As has 
been stated previously (Chapter Three) , we believe 
that people should report v/hat they are doing in terms 
of purposeful activity. That is something they can 
assess . 

Secondly, we believe that the categories are ex- 
cessively broad. In viewing the progress of a 
research and development program, we believe NIE will 
want to know the degree to which activity is moving 
from dofjign into application and thence to evaluation. . 
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When cross classified with work units , the categor- 
ies we have specified describe progress in the design, 
application, and evaluation of that unib. Further, 
administrat-i vo activity is not inconsequential, and 
wo believe that the sovc^ral overhead categories 
in our classification system provide a useful break- 
down of administrative cost information. Further, 
vendor negotiations and liaison with the fundor (NIE) 
require substantial resource commitments and cost, 
especially during certain time periods, and it is in 
the best interest uf NIE to analyze the degree to 
which that activity affects the performance of vendors. 

Replication Categor.i os . We believe that Mountain 
Plains is v;ell along the way in issues related to 
cost estimates for potential adopters. This is 
especially so in the case of Education Service cost 
centers (See Chart V) . These are categorized into 
kinds of training by occupational area or subject 
matter as appropriate. 

We do not have a wel 1 -formulated list of services 
which describe the Mountain Plains process relative 
to adopter needs. However, we believe that their 
specif iciation should focus on the results expected 
from each process in terms of effect on family. 
Chart II provides some direction. Its further 
refinement v/ould be beneficial. Hov/ever, even in 
its present state, v;e note that such services as 
(1) initial faiv.ily adjustment, (2) orientation, (3) 
piacoment skills, and (4) follow-up and follow- 
through are client services which are not present 
in the current reporting system but which are 
distinct elements of the treatment process. (We 
are not fully satisfied v/ith Chart II and do not 



career guidance are not categories in terms of 
results but inpiiits. These categories should be 
analyZ'.'d accordingly. The question should be: 
Counseling — To produce what result? Career 
Guidance — To produce what result?) 

Should such a classification of treatment 
services, or production departments be formulated, 
v/e believe that assignment of resource requirements 
and cost based on the proportion of total student 
time (student time records) allocated is not accept- 
able. To be so, one needs to assume constant ratios 
of student time to all other resources. Instead, 
direct records should be maintained. 



wish to so indicate. 
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This is not moant to criticize the reporting 
time: of student time in activities. Mountain 
Plaint! maintains extenfiivo records of student 
allocations. Then disaggregated ratios of resource 
requirements to students or student inputs could be 
formulated. This, as v/as shov/n in Chapter Four, is 
the basis for adopter information in a setting of 
changed levels of services in project operation. 

B, Staff Time Reporting 

The reporting system could be modified to handle 
the additional dimension imposed by service components 
(e.g.. Chart II) classification. Time reports would 
substitute the service (or component) dimension for 
the date dimension (see Chart VI) . 

This would require that time reports are submitted 
on a daily basis. 

* 

This is not a loss but a gain. Not only would 
additional information be obtained, but contempor- 
aneous reporting would be encouraged and reporting 
accuracy increased. 



IV. SUMMAI^Y 

Mountain Plains has a system v/hich separates the 
costs of research and developriiunt from operaions. How- 
ever, we believe disaggregation into additional cate- 
gories is necessary if the data is to be useful to NIE 
for purposes of monitoring research and development pro- 
gress . 

The categoiy of operations is inteiided ro provide 
estimates of cost at adopter sites. This is essentially 
our lower bound estimate. We believe that the classifi- 
cation of activity and cost into operations based on 
staff perception of the necessity of their' continuation 
in a non-development setting is not v;ise. Either staff 
must perpetually speculate, or administrative rules are 
imposed. 

Actual resource requirements, which can be priced 
at the adopter site, are more important in any case. 
We believe Mountain Plains retains these for staff 
time but that physical resources may be more difficult 
to reconstruct. 

Also for replication purposes , the categories should 
be in torms of accom)-ii i shmcnt of the goal related steps 
in the treatment process. These we call component 
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servicofj or task categor.ioij . Those aro not yet complote 
at Mountain Plains, but work is going forv/ar'd. Resource 
allocations into those components should bo direct. 

Finally, Mountain Plains maintains records of student 
time allocations into the j^rosent categories which arc 
approximate components, and will continue to do so when 
refinement of the component structure is accomplished. 
Such records will prove valuable in estimating resource 
requirements at changed levels of student enrollment. 
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Chapter Eight 



ACCOMPLISHMENTS, CONCLUSIONS, AND RECOMf^ENDATIONS 

This summary will be divided into three sections. These 
are (1) Accomplishments, (2) Findings, (3) Recommendations. 
They have been modified in light of a second investigation 
of NWREL during June of 1974. 

I. Accomplishments 

A. A structure for a record system which will report con- 
tractor program development costs to the fundor in 
terms of standard research and development activities 
and budgetary work units was designed. 

B. A tentative structure of a record system from which - 
estimation of adopter costs could be made was designed. 
A method of estimation based on that record system 

was suggested. 

C. The accounting systems of the present career education 
program research and development contractors were 
compared with the systems referred to above. 

D. The accounting systems of the present contractors were 
compared with one another to determine the potential 
for uniform reporting procedures. 

E. An additional study of the cost system at Northwest 
Regional Euucational Laboratory v/as completed over the 
period of June, 1974. March, 1974 costs were assigned 
to ARIES Standard Categories. Costs were assigned to 
ARIES Standard Categories. (See Appendix B.) 

II. Conclusions 

A. Considerable diversity exists among the resource 
allocation and expense recording and reporting systems 
of research and development contractors. 

B. Contractors employ different conventions for allocation 
. of some resources and expenses and for proration of 

indirect costs to their several categories —even when 
the categories themselves are similar among contractors. 
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C. Some contractors do not trace the cost of facilities 
and associated utilities and services to the program 
staff members who utilize them. Instead, these 
resources and costs arc absorbed into general manage- 
ment or contractor indirect charges. Facility costs 
are therefore under reported and inaccurately appor- 
tioned . 

D. Controllers of Model II contractors have indicated that 
they could; and would be willing to, provide uniform 
reports v/ith respect to allocation and proration 
conventions even where this requires special calcula- 
tions. 

E. When contractors are grouped by the kind of career 
education model under development. Model II contractors 
provided very little operational cost detail but great 
detail under development, evaluation and other non- 
operational activities. Model III provided very little 
detail with respect to the operational-developmental 
dichotomy of program development cost reporting but 
significant detail v/ithin operational activity. Model 
IV provided significant detail within both operational 
and nonoperational activities. 

F. For contractor does the recording and reporting 
system distinguish sufficiently between those expendi- 
tures of time and dollars on activities directly 
related to final development products (s) and those 
related to supporting and secondary tasks. This 
v/eakens the ability to eliminate the cost of those 
supporting and secondary tasks, which v;ould not con- 
tinue in adopter settings, when formulating cost 
estimates . 

An important research and development activity that 
ARIES has designated is Fundor Negotiation and Liaison 
(FNL) . At NVJREL, staff are aware that this activity 
is performed. However, since no associated reporting 
category is provided, Fundor Negotiation and Liaison 
activity is spread among numerous other categories. 
Fortunately operational s haf f are separated from 
involvement with preparation of reports to NIE, a 
heavy contributor to FNL, and therefore applications, 
or operaticnc, costs reporting distortion is reduced 
thereby. However, this is due to a very definite 
separation batv;ecn development and operational staff 
which exists at NVJHEL. At developer sites where such 
a separation docs not exist FNL activity may be 
included in application, or operational, costs. Tlie 
rc:"3ult will be an upward bias. 
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G. For at least two of the six contractors, the resource 
requiruments and costs asGOciated with acquiring the 
capacity to deliver program services (acquisition 
costiO v;ore not Gpeciiically recorded in the develop- 
mental setting. They are, therefore, lost. This is 
especially true with respect to allocations and costs 
of personnel. This will impede estimation of adopter 
acquisition costs. 

H. For some models, come acquisition tasks continue in an 
operational setting. Therefore, the cost of acquisi- 
tion for those tasks can be estimated by analysis of 
operational costs, assuming the operational cost record 
is sufficiently detailed by component services. More-- 
over, a record of results, or output, of acquisition 
services must be kept. V'Je do not believe that detailed 
and results records are maintained at present. 

I. Accuracy of adopter cost estimates will be promoted if 
the developed program is field tested in a location 
other than the development site, if a more detailed 
cost accounting system is introduced, and if cost 
estimates are based on the associated record of resource 
allocation. This is especially the case for program 
acquisition costs. 

J. One problem, in estimating service delivery cost is that 
the degree of program design and evaluation which occurs 
in an adopter setting is unknovm. 

Most contractors utilize a category of activity termed 
operations as distinct either from research and develop- 
ment in toto or from research and development component 
activjti.GS such as development and evaluation. This 
practice tends to produce a single estimate of adopter 
costs v;hich assumes* that neither program development 
(v;hich v/e have termed Design) nor program evaluation 
takes place when the program is adopted. 

K. The level of wages and prices, but especially staff 
wages and salaries, will differ between development 
contractors and program adopters and also among adopters 
in different regions and demographic settings. For pur- 
poses of estimating adopter costs, emphasis must be 
given to the physical quantities of resources required. 
Costs should be based on wages, salaries, and benefits 
likely to be paid in adopter institutions. 

L. The program resource requirements which will require 

additional expenditures by adopters will differ between 
dcvo.l opruGn t con trac Lor s and adopters and also among 
adopters. This again underscores the specification of 
phyiiical requirements for resources in addition to their, 
cost. 
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M. The reporting of operational (wo term these Application 
Activity) costs by several contractors does not detail 
operational costs in terms of program service components 
and student behavioral results. As a result, for these 
contractors, no estimates can be attempted when the com- 
position of program in terms of its service components 
is changed from that at the time of measurement. Most 
contractors hope that their program will be structured 
at adopter sites in the same manner as at development 
sites. However, at NVWEL, in June, it was apparent 
that adopters may desire to modify proyiam structure. 
At that time the need for a more detailed description 
of operational activity becomes evident, 

N. At NVJREL, ARIES found that at least in soiae instances 
staff reported time for one activity to some other. 
This was explained as being due to a NIE requirement 
that staff may not report (or be billed) for activity 
other than that for which they were originally budgeted. 
(See Appendix B. ) 

0. Based on subsequent work at NWREL, rough estimates of 
annual per pupil costs ranged from $4254 to $1724. 
(See Appendix B.) 

III. Recommendations 

A. For future reporting of program development resources 
and costs / we recommend development of a system which 
does not, in itself, explicitly attempt to distinguish 
research and development activity as distinct from 
operational activity. We also recommend that all staff, 
developmental as wall as operational, have accessibility 
to the same reporting categories. 

B. The resource allocation and cost recording and reporting 
system should utilize two dimensions in addition to 
customary line item. The first should consist of a set 
of standard categories which describe the major activi- 
tiqs to wl^ich resources are assigned in any development 
project. The second dimension should consist of cate- 
gories which describe the fundamental products of the 
development effort. The primary product (s), should be 
described in terras of their service components and 
general treatment results. ^ with appropiiute specifi- 
cation of cost assignment and proration conventions, 

the result v;ill be uniform cost reporting with capacity 
to analyze costs in terms of products and their compon- 
ents for purposes of analysis, program description, and 
resource and cost estimates for adopters. 



1. See Page 27 Chapter Three. 

2. See Chapter. Four, especially Page 73. 



C. We rccomniGnd that future budgetary work units be con- 
structed in terms of the major developmental products 
and the service subcomponents and treatment results of 
the more significant and complex of those products, 

D. Estimation of adopter costs should allow for the uncer- 
tain degree to which program design and evaluation are 
part of adopter operations. This can be accomplished 
by providing an upper estimate which includes Design 
and Evaluation activity and lower estimate which does 
not. However, based on subsequent work, ARIES recom- 
mends that only Design and Evaluation activity of 
operational staff be included in the upper estimate, 
(See Appendix B. ) 

E. The structure of standard developmental activities should 
be sufficiently detailed to include those which are sec- 
ondary and supportive as well as those which apply direc- 
tly to development of the project products. One bene- 
fit of this procfidure is that resources and costs 
allocated to activities unlikely to be continued in an 
adopter setting can be identified and eliminated from 
the estimates of adopter cost, 

F. Estimation of adopter costs should reflect differences 
which exist between developers and adopters and among 
adopters in different circumstances, 

G. Two kinds of estimates should be provided. One is 
applicable to exploral-nry uiacussion before a great 
degree of detail is required. This we called the 
exploratory estimate. It should begin with resource 
requirements and apply wages, salaries and other signif- 
icant resource price values which are national averages 
for the resources employed in nondevelopmental , or 
adopter, settings. 

The second estimate we termed the adopter incremental 
estimate. Again one starts with program resource 
requirements. However, the adopter eliminates the 
quantities of resources available at no added expense 
comparpri to present operations. Then wages and prices 
are applied. These are to be typical of those found in 
the adopter market. It is absolutely essential that 
the physical quantities of most resources be specified 
with cofjt built upon that data, 

H. Our assessment is that contractors arc willing to comply 
with uniform reporting of program development costs in- 
sofar as additional calculations based on their present 
systems arc involved. However, they resist frequent 
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changes in the structure of resource allocation and 
cost recording v;hich have an impact upon program staff. 
Consequently, installation of a system like that of 
ChapLor Three and Four may be difficult at this time, 
but sliould be considered— with appropriate modifica- 
tion and development — in field tests of the developed 
programs . 

Regardless of the data collection system (the categor- 
ies to which resources and cost are assigned and the 
procedures for collection of that information) , we 
believe that estimates for adopter cost should be based 
on upper and lower values, or limits. V7e also believe 
that adjustment for differential wage and price levels 
between adopter and developer settings is important. 
Moreover, provision must be made for allowance of re- 
sources available to adopters at no incremental cost. 

J. A list of average adopter prices for significant program 
resources, particularly staff, should be compiled. 

K. Contractors should begin to formulate estimates of the 
resource requirements of program adoption as soon as 
possible. We feel that significant problems will be 
encountered, and that it is best they become apparent 
now. As far as possible, allocation of significant 
resources should be in terms of physical units. For 
the purpose of making these estimates, contractors 
should be requested to define a set of program service 
components and to assign resource requirements to them. 
Contractors should make explicit the source of data and 
the means of resource assignment. (Measured? How? 
Prorated? How?) Where no system presently exists, v/e 
recommend refinement and installation of a system based 
on that of Chapters Three and Four. It will be as 
consistent with other systems as any. 

L. Again, if there is interest in anticipating adopter 

reaction, it would be wise to request a representative 

sample of potential adopters to identify those program 

resources (from those compiled under K above) which 

they will not require due to prior availability. 

We have suggested a set of recommendations for reporting 
the coats of program research development and for esti- 
mating ado};>ter costs of program service delivery. If 
development v;ere just now beginning, we would recommend 
installation of a system similar to that v;hich evolved 
through Chapters Throe and Four. However, the present 
programs arc well into their projects, and implementa- 
tion of that sy.sl.em^ vihich is somewhat different froii\ 
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theirs, would be — we feel -resisted as a disturbance to 
the development effort at this time. Moreover, in some 
cases, significant data have been lost and institution 
of a now system will not retrieve lot'.t data. It may, 
however, provide a better means for its estimation. 

Not all of the procedures for estimation of adopter 
cost depend upon the existence of the system we devised. 
Specifically, the emphasis on physical requirements and 
the provision of upper and lower exploratory and of 
upper and lower incremental which can be adjusted for 
price and availability adjustments can be applied to 
many sets of data. The ability to do so will depend 
upon the degree to which data approximates that which 
would result irom the system we recommended. We strongly 
recommend that the procedures of the type outlined in 
this report be considered for application to the estima- 
tion process, 

M, Nonroutine cost questions for research and development 
projects, must be specified early in the life of the 
project, A cost/information system must then be designed 
which accommodates the questions as specified. If uncer- 
tainty exists as to the particular questions to be asked 
or to the particular data required, then the cost system 
should be more rather than less detailed, A more detailed 
system at early stages will assure that cost questions 
will be answerable. In addition, as questions are further 
defined and data requirements specified, the system can 
be simplified rather than complicated v/hen modified. 
This will increase rather than decrease staff cooperation 
and morale. 
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FORI'li\L SPKCIFICATION OF COST TREATMENT 

In this section we will sununarize and refine the abstract 
content of the cost system v/hose general chairacteristics have 
just been descrilDcd, We shall be concerned with definitions 
and transformations which convert data captured by the pro- 
cedures described above into a form required for entry into 
the cost report illustrated in Chart II of Chapter Three. 

Raw data will fall into two general classifications. The 
first is that which describes the allocation of resources in 
terms o£ physical units. The best illustration is staff 
time allocations. The second category is data describing 
the allocation of money payments which are difficult to 
associate with resources. Transfer payments to students 
are included in the second category. 

Those resources reported in terms of physical units will 
include both personnel and nonpersonnel resources. Some of 
these can be traced to specific combinations of subproducts 
and activities; the remainder can not. The resources which 
can be traced to specific combinations of subproduct and 
activity v;e will call subproduct/activity direct, or simply 
direct resource allocation. These will be denoted as: 

1. ^iik " '^^^ number of hours allocated directly 

by the i^^ personnel resource to the j^h 
product and the k^^ activity, or 

2. ^ijk ^ '^^^ physical units of the i^^ non- 

personnel resource allocated directly 
• to the jth product and k^" activity. 

The time subscript, t, will not be carried in this discussion 
However, it should be remembered that all data is dated. 

These may be summed across any and all subscript indexes. 
In particular, 

3 k 

will be the total allocation of direct time by the i^h staff 
number . 

If CMj is the compensation accrued by the staff person, 
then the affective rate of monetary value of compensation wil 
be 



A-1 



4. 



Wi « CM./L*,,, 



which is the dollar value assigned to one unit of personnel 
time. 

This rate can be used to assign the cost allocation of 
staff time to any given combination of product and activity. 
That is, 

5. (CX;^,,)* = (w.) (L^.,^) 

= The co3t of the allocation of time by 
the i^^'h personnel resource to the j^^^ 
product and kth activity. 

Expression 5 is one fundamental building block in the report- 
ing of research and development costs. 

Some nonpersonnol resources also can be directly assigned 
to a specific combination of product and activity. In cases 
where t}ic contractor purchases from an outside supplier, the 
invoice or purchase order can be expected to record the 
physical quantity of goods or services, the unit price and 
total charge. It can be structured to assign ordered goods 
and services to a given purpose or cost center. Where this 
is the case, the ordering-billing system provides values for 

R| = The quantity of the i^^ resource 

allocated to the jth product and k^^^ 
activity 

6. (Statement #2), and 

the cost of the i^h nonpersonnel 
resource directly allocated to the 
jt^ product and k^h service ♦ 

For purposes of reporting research and development costs, 
^ijk v/ill b^^ sufficient. When considering replication resource 
requirements (see next chapter) the physical quantity, rJ^j^/ 
v/ill be required • The same also applies, of course, to 
personnel resource units, L^jj^, 

The total of personnel and nonpersonnel costs directly 
assignable to a given product-activity combination v;ill 
therefore be, 

7. c*jk - (c5:jj,)* +(c5jk)*. 
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The quantity given by the sum over all resources, or 

,jk i=l ijk 

is the cost of all resources directly assigned to the product- 
activity combination. It is this value which is to be entered 
in the research and development cost report reproduced in 
Chart V. In like manner, the quantity, 

^n 

9. C* - C* , (k - 1 s) 

..k j=l .jk 

is the cost of resources directly traced to the k^^ activity, 
summed ior all subproducts and products. Similarly, 

10. C* - C* (j = 1, m) 

.j. k=l ,jk 

is the cost of all resources directly traced to the sum of all 
activities under the j^^ product. 

The second large category of resource allocation and expendi- 
tures are those which cannot be traced to a given product- 
activity combination. Such resources, when measured in phys- 
ical quantities, will be indicated by a notation Rf^, When 
measured in money value, the notation will be Cj(. The sub- 
script, h, indicates the resource, and h = 1, 2,-.,,m. The 
superscript, #, indicates ' that the resource and cost is not 
product-activity direct. 

Of these resources, not all will be treated identically. 
Some can be traced as far as a particular staff member. 
These will be called staff-indirect and will be indicated by 
the notation 

11. , . . = The quantity of the h^^ resource 

traced to the i^^ personnel resource 
and, 

^h(i..) = The cost of the h^^ resource traced 



to the ith personnel resource. 



13. ~ '•'^he unit price of the h^^ resource 



We will allow 
'h 



so that 

14. cj(i..) = (cj^) R 



h(i..) 
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Some indirect rosourcoa and costf5 will be traced only as 
far as a given yubproducl:. These will be termed product- 
indirect and indicated by 

15. / ^ V = The quantity of the h^^^ resource 

traced to the jth product, and 

16. -i ) ~ ^'^"^^ cost of the h^^ resource traced 

to the jth product. 

Others will be traced only as far as a given activity. 
These will be defined as activity-direct and indicated by 

17. . ?s The quantity of the h^^ resource 

traced to the k^h activity, and 

18. ct/ = The cost of the h^^ resource traced 

"^••^^ -to the ktl^ activity. 

Finally, resources and costs v;ill be traced only as far as 
the project itself. These we will call pro ject- indirect . 
They v/ill be denoted by 

19. ^h(...) ~ quantity of the h^^ resource 

traced to the project, and 

20. ..) ~ '^^'^'^ cost of the h^h resource traced 

to the project. 

Since the units of these resources differ -they cannot be 
aggregated. However, their cost can be aggregated as 

21. C* . = c# 

.(1..) ^ h(i..) 

= The total of all staff-direct 
resource cost 
staff member; 



resource cost traced to the i^^ 



m _^ 

.(I..) -frj .(i..) 

= The total of all staff-indirect resource 
cost traced to individual staff members, 
summed for all staff. 

(This is entered at the intersection of row 30 and column (14) 
in Chart V. ) 
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23. C*^ / ■ V = 2 C* , 

h-1 . (o • ) 

=5 Tho total of ci]]. product-indirect 
rosourcG cost .traced to the j^^^ 
product; 

(This is entered in the cells of column (16), Chart V.) 

^.(..k) ^ ^.(..k) ' 

~ The total of all activity-indirect 
resource coats traced to the k^^^ 
activity; and 

(This is entered in the cells of row 34, Chart V.) 

25. C«(...) C« , 

h=l h ( . . . ) 

= The total of all project-direct costs 
traced to the project. 

(This is entered in the intersection of row 20 and colmn (p) . 

These indirect costs as so recorded are not assigned through 
proration to categories of cost beyond the point to which the 
cost can be traced. As stated above, v/c do not favor proration 
since it is arbitrary and lends an atmosphere of precision to 
cost figures which are not precise. Moreover, to the extent 
that costs are interpreted as increasing directly with changes 
in the level of activity, the imposition of prorated indirect 
costs may actually be misleading. 

Nonetheless, we recognize the strong tendency to assign 
indirect costs. Tne cost report makes provision for that. 
Therefore, we will conclude this section with a discussion of 
cost proration and assignment. 

Staff-indirect costs are assigned as follov/s: Recall 

^h(i..) ~ '^'^"^ quantity of the h^^ resource 
traced to the i^^ staff member, 

(Here we. a.ssumo that indirect costs are nonper sonnel . To 
the extent this is not true the variable htti \ can be 
defined) nvi..; 
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Staff-indirect costs will be assigned on the basis of personnel 
direct costs of the i^" staff member. That is, 



n s 

Then we may form the ratio ^ 

26. ri = Cf(i..) / L*(..) . 
Then , 

27. C* .... = (r.) L*., 

This value is not recorded in the cost report. 
However, we may now form 

28. „ . m s C* , . , , 

^ i=l k=l 

- The assignment of staff indirect costs 
to the j^^ product. 

These values are entered in column 14 of the cost report. 

These values can be recorded in column (m) of the cost report. 

Similarly we may form 

29. ^^.\..k) = ^ ^ Cf(ijk) - 

The assignment of staff-indirect costs 
to the k**^^ activity* 

These are entered in row 33 of the cost report. 

Product- ind irect costs are recorded without prorati on in bo 
column (o) of the report. However^ to apportion these costs 
to activities^ we must form 



30. rj - Cf / Ltj. , and 

SuiTuning, we airive at 

m 



which is recorded in row 35 of the report. 

Activity- indirect costs are recorded without proration 
into row 18 of the report, Hov/ever, to apportion these across 
product categories/ we must form 

= ^*(.:k) / ^*.k ■' and 
Summing, we produce 

m m 

35. Cflf.j.) = ^ S Cf(ijk) . 

1=1 3=1 

which is recorded in column (15) of the cost report. 

Finally; we consider project-wide costs. These are entered 
without proration in the cells at the intersections of rov/s 30 
and 36 with coluinn (17) . However to apportion these across 
product categories; we must form, 

36. r . V = C# / \ / L* , and 

which is the proration of project direct costs to each product 
and is entered down column 17 , and 

38. Cf(..k) = (r(^)) (L*,k) ' 

which is the proration of these costs to each activity and is 
entered across rov; 36. 

We havo referred to those indirect costs which cannot be 
traced to any !::pocific project of the contractor. They are 
terinod project-indirect costs and arc denoted as 
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39. C^^ . 



ThesG are apportioned to the project by the contractor. 
Their value is entered at the intersections of rows 30, 36, 
and 38 with Column (19). The chart does not make provision 
for further apportionment to activities. Proration to 
products, however, is provided for, and is accomplished by 
forming 

40. r^ = cj^ / L*...) ' then 

^^c) ' (j = 1, 2 ... n) 

the values of v;hich are entered down Column (19). 

In this discussion we have pointed to the distinction 
between resources dimensioned in physical units and the value 
of resources denominated in money units as cost. Hov;ever, the 
research and development cost report is in terms of dollars. 
Therefore, whatever has been stated above with respect to 
costs derived from physical units also applies to costs derived, 
due to reasons either of principle or of practicality, in money 
values only. Thus the cost figures should be considered to 
include them. 

That being the case, the rem.aining entries in the cost 
report are formed as 

42. C = C* + C# 

= The sum of costs direct to product/activity 
categories and costs which cannot be traced 
directly to that extent (and which therefore 
are indirect to product/activity classifi- 
cations ) . 

In the table, C indicates cost totals with contractor- 
indirect costs excluded. such totals appear in row 38. C 
indicates cost totals v/ith contractor-indirect costs included. 
These are recorded for each product and various totals in 
Column (20). 



A- 10 



APPENDIX B 



A REPORT OP ARIES' 

SECOND COST ANALYSIS 
OP NVJREL 



TABLE OF CONTENT S 

1.0 Introduction B-1 

2.0 Work Effort B_2 

3.0 V7ork Results B-2 

4.0 Conclusions B-26 

Exhibit A B-29 



ERIC 



APPENDIX B 



1. 0 Introduction 

This work was commissioned subsequent to completion 
of ARIES' report, Do s i gn, Assessment, and Roc oinmo nd a t i o n 
for Reporting Education Program Research and Development 
Costs and for Kstiiiiating Service Delivery Costs of Program 
Adopters , of March, 1974. The repo"rt~outlined a frame- 
work for a cost-resource reporting system which would 
enable NIE to accomplish two goals: 

(1.) To uniformly report research and develop- 
ment costs across programs • Such a system 
would have to employ uniform categories 
and procedures to be meaningful* 

(2*) To report costs in such a manner so as to 
promote dissemination of program results 
to operational applications. Accomplish- 
ment of this objective requires that, in 
addition, cost be structured on the basis 
of the principle components of the parti- 
cular program under research and develop- 
ment. The more extensive the program the 
more complex the structure of the required 
cost system. Such a system will not be 
general, or uniform, in the sense above. 
Its categories for report will be specific 
and unique to the program* However, the 
reporting procedures and assignment rules 
should be as uniform across laboratories 
and contractors as possible. 

The work to be reported in this document had several 
purposes and results. The first was to determine the 
degree to which the ARIES cost data could be completed - 
after the fact through an analysis of prior records. 
The second was related: To illustrate the result of such 
a system* The third was to provide a basis for revision 
of the first ARIES report. 

Northwest Regional Educational Laboratory (NV7REL) , 
Portland/ Oregon was selected as the application site. 

Work v;ns executed under a severe restriction -~ 
the investigator was not permitted to contact depart- 
ment staff. This is a severe, but understandable con- 
straint. Operational staff strongly feel compromised 
when complying with numerous tasks and requirements 
which arc not directly related to operational activity. 
Secondly, thu pro.scnt- ^;yritom is the fourth cost system 
for staff at Northwest Regional Educational Laboratory. 
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staff can hardly ho blamed for viewing involvement v/ith 
yet another syr^tcm with some disinterest. Subject 
to the above severe restriction, the investigator received 
full and open coopcvration at NVJREL, 

2.0 Work Kf fort 



The v/ork proceeded in several stages. First, the 
investigator met with the NWREL project director and 
clarified the nature of the task and established "cross 
walk" relations between NWREL/NIE and ARIES categories 
insofar as possible and in order to establish sources 
for the required data. The result was outlined in a 
letter from ARIES to NWREL. The relevant material is 
included as Exhibits A-1 through A-25. 

In the second task, the investigator identified 
and analyi^ed the original source records for a given 
period. The month of March, 1974, v/as selected. The 
result was a detailed assignment of item costs to NWREL 
categories. The expen«^x tures assigned to NVmEL categories 
were reassigned to those specified by ARIES. This was 
accomplished on the basis of the cross walk established 
in the second step and of interviews of those staff access- 
ible to the investigator. Ideally, NWREL cost data should 
have been categorized into both ARIES systems that re- 
quired for the ARIES Standard Report Categories which 
describe R&D activity and that required for the particular 
categories required for the activities specific to 
Experience Based Career Education (EBCE) at NWREL which 
is the basis for estimating adopter costs. However, due 
to the restrictions noted above the latter was not 
accomplished . 



3.0 Work Results 



The results of ARIES ' transformation • is displayed 
in the following tv/o charts. Chart I contains the assign- 
ment of costs assigned to NWREL. Chart II contains the 
assignment of costs assigned to a NWREL subcontract, that 
of CE2, the operational EBCE school organization. Each 
chart lists expenditure items as structured by NWREL 
and CE2 accounts in the left hand Item Column. In Chart 
I, the remaining numbered columns report: 
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2: 


Column 


3: 


Column 


4: 
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NWREL Overhead Allocation 

NV7REL General Telephone and Facility 
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Application Category 











• 


















I 






• 1 


















































V. 




I * 




♦ > 








t*' 





o» t- r 
i.'. o o 

•r- vt 

<Xt ♦» — 
«J» it) <fS 

l» Li 



C» c: C 

;t o o 

w ♦J 

•! in 

\j . 

t -4 



c 
o 



•r* 



0) 

I- 

J c 

U 'O 

o 

f J 4* 

t 





C 


4-* 


■r- 


U 








•^J 




O 


tr 


I.. 




a. 




c 




o 












^ *^ 





















s 



c 



01 

o 



c 

CI 

t- 

-J r/» 
til 



ill 
I 



M) «>% Q 









■ ' 
















n 

a #— 'J - p 




n: 




t . ^ 




•t 




CI VJ M 






■ :■ 'J "J 




o 




ft U. tj 


UJ 


4' 


o 


o o 


r. 






• n J 


:< 


to 




cy V- * . 




4> 


o 


.tj ♦ c ^ 


V 


o 






o 


o 




. t ; 

•♦^ . 


♦-» 


>l 


O 


♦rj ■ * 


c 






C» '•J 


o> 

1 


♦ * 


T) 


l.» V. i> , 


c: 
1 •■ 


nj 


*n 




V. 


tJ 






t> 


t 




v» 


4i 




1 




"J 






•C 


J 







^1 ::i 



1^ 









V» 




















r 
ci 














r 






u» 




C) 






Qi 
(. 




♦ J 






t1 










•L 












CI 






••1 




<-.» 






Jo 










iA 




.V 


r 










*> 




KJ 




















V 


• 1- 












f 1 


«^ 


<Q 


r 




t 1 






( 1 














C J 


iii. 


















1 











ERLC 



ft 



M SI 



5:1 



:?2 



"SI ' 



5:1 



c: 












c 


d 


l* 






»» 




1 




0 




0 






CJ 














4 i 




1 








4i 


• 1 




1^ 


1 












"J 


*J 














'J 


V t 


















tl 








Cj 






»- 
























It 


c 1 




n 


(/) 


1 






«t 










r 


,1 




c< 










t i 




v\ 






4> 








• V 










«J 












<D 




i : 
















r • 


I \ 






( 1 






M 






*:i 




xs 






, J 






r • 


•<1 


l- 














♦".1 




^4 


1 


U1 






c: 




>- 


»-4 







r: 










0 


c: 










0 




ir. 




>-i 






OP 






4* 




1 




1 > 


"» 


4 t 










(M 


J ; » 








1 1 

u 












C 






«t 






C 


1^ 








<'J 


CJ 


Qi 




VI 






t 












'J 




.J, 




C 




I- 




»— 


1 I 


L. 








ai 






fie 


U 




•tl 


nt 






a* 


C 






u. 


»- 


»-4 


1 

1^ 


«« 




4N 





t 

§1 







r 






♦J 




0 


r: 




i: 




•r* 




c: 


o» 




4> 




(} 


J- 


c« ! 


♦U 


41 






: ■ 


r J 




4-1 




fit 


« .» 




/•I 


.M 








1 J 


t 










'♦5 




*x 




f ' 
















(A 




*i* 


1 




(11 


<u 






%A III 




IT 


4J 


4-» 


<ll «l 


41 




I J 


t' 


X 








QI 


I. 








i 


f«l . 








tx. 


a: 1 


U 






a 




"1 




v: 




u. 


1 - 


♦ -4 



n-3 



•J. 



ERIC 



V. i: 
<u ••• • 

r r t» 

&J II 4* 
10 •I. t4j 



i; 



«^ i. v. 

Ul (i. <-3 



«» c c: 
••• m 

01 



I 

.CI y 



^ u o 

O rtJ A> 
•U 

H «» ♦J 

:> o 



^- 



♦J 

c 

I: 



Cn 

U CI 

O C 
I- 



c 
o 



Id 

> 
tj 



c 
o 



(X 



t/1 



or 



:-2 V- 

o 

O <V 
O O *i 
rJ 

♦J >»o 

C 

U O T3 



tJ tii 

tA *r3 4» 
•C -J t/1 



4J 




t* 




t) 




ti 










lU 








:< *A 


















o »— 


«j 


j; 


•o 


fv u 


u 




o 


U. 




Hi 


f- • 








c? 




o 


TP 






*J 


CJ 


<w 


-J t: 


IJ 


Ul V- 


CI 






1' o 





1 I 



^1 ' 



^ 3 



^.^ n 



- « 



I 



1^ 



U ^ 



5;i 



51 



I 



I 



^1 ^ 



u 




.V 


















•« » .1 






t : 






rS 


o 






(21 




. J 






tj 






O 






i ♦ f-. 










V. 


U 




~i 








L.i 








llj 


01 








o • • 


t > 


1*1 


1 




ni 


C7 


1>1 4^ 


I'J 




r 














•» I 




t» 






fi 


4^ 


r- 


J J 




f <»1 \A 


tr. 




t J 


C J 


:5 




f 








V . 




V 


^- »i 






4J C 














t « 




4 1 


^•> 


«X 


;* 








-t 




•C 




• • t) 


^ 


c) 


*i 


i' o 










* - J 


t. 














4 » 










•11 


t: 




*♦! 








«)< 


1 


•♦1 


4i 


4J 




i 




f» .*J 


l^. 


>. V 


44 




1 


I- 




4^ 


> 4J 






?' 


4 • 


4J 


4» 




( ) 




• • 








♦ » 1 ) 


1 t 




» I. 1 


\ 


•'•t 


(J 


• • UJ HI 






Oi '-I 




rj f 




u 


o 


c> 








i 1 


X 






( > i/t 




>C 


<y 


o u 


t J 


r. 




n. 


^ - *\t 


.» 




u 












1 1 


L. 












• 






t 




in 1 








to 


\ 


"J 










1 •. 


c. 








c*) • 


1(1 








f- It 


t 


ti. 


1 1 




1 ) 






t-" 


l .» . - 


1 1 




> CJ 








•. ^4 


CVl 


4i 








CI 


.> 


V 




t > 






I > 


/•J <iJ 


t , 






4' 






4-» t 




••1 










( ) 


* -« 


1 


r- - 


to 






u. 




i 


t -J 








1 rtt ri 


1 


^ 
















•I* 


























¥ - 














tn 


» 






1 
















«,L 










































O 


# • 


> 
















t i 






! 




















UJ 












UP 


m r« 


«♦ 






















tf t f « • « f 
• « *«i • « 








I" «• 



n-4 



^ O 

LiJ «J !> 

C< 

:•: »A V. 

r: o 

»^ c ^ 

o •* 

>«LJ 

I. i- 
i 

u» V. ^> 

«/1 Xl tj 

t/> 1 ♦> 



I- 



ERIC 



I. it 

I i: u 
a> «-» 

C3 •t lU 



Ci C 
CI 

to a. 



O 44 

LTV 

r: r: 
o o 

ft* ♦J f- 

4J «1 

T- •»■• 
lO -J 



.01 C IT 

;£ o o 

, I, 'r- 

O rtj A3 
•O -'^ 
-J 



«0 
C 

n 

o o 

O -r* 



♦J 

(J JET 
nj -r- 

o n 
I. 



40 

> 



4J 



01 

f. 

l: 

-J r- 

:< *x 

i? 

0 'J *-» 

X. M 'rj 

O.U. <J 

01 o 

»- 

O t: 



o 




^ 



I 



I 



I I . . . 

Q ,^ 



I 



!?l ^ *l I 
(Vj . 



01 



44 

or 



I 91 

: I . 



5\ 



3 
2 



£2 

ea 





4^1 


















» - V- 




r 


t • 














4 » 




'if 


I 




t 














a> oi 




ti 


c> 














nj 


4 * 


n 






o 














tu 












*/i 






»J 










V. 












J ; 






c 


4J 








01 




V- n 


O 


tJ U ; 
















I. 




Ln 


dj ^ <M 






ti 
















0 0 


♦J 








-J 
















c\ 


rj 




r 






OJ 








f 






rt> 


if 








t1 


) 


I . -L- f 


it 




J 




rj 




tx 


4 * 


^ .L- 






<•> 




%A 


V. ^- 








4 < 


1. 


1 ■ 


<•» tj 


'i* 




O 


I. 






tx 




■^4 1 


•c *t 




t 11 




•j I 


Jl 






f 


ai 


■ 


4J ii L 


ti 








l- 


J 


-* 




^ I- 


OJ 




'n I '. 


I. 












( •» 






fj 


f. 


4 > 


I* 




1 • 


u> 




fl 


t: 






4* o 






^% 


» • 


*. 1 


4J 


( 1 


11 


•» • 


^- 




C" 


.u O 












f ; 




f > 


^« fi 


I.. 










*■ • 


a: 




r i <.t. u 


r«. 


) 


Ql 






dJ 




Itl to 


4: 






:l 










<5> 












:t 


V- 


► 4 < 1 


V 


« -4 


u 


4J 


«» (J 


i I 


:;:.!: 


in 


ti • 








u- 




1/1 




«.J 




tj 


V J 


••J 




f 1 






c 


:c ♦»> 


AJ 




IVJ 


C KJ 










i- 


r 




t/» 


t: u: 


«^ 


to 
































i> 




(.) 
















«4 - 








I- 


1 










1*1 
























o 








U. "4 ' 

f 


CO 






■» 












! ■ 


















1 
I 


























1 
























1 




















f* 


t- m r* 




» t 
f « 


• * 


♦ fJ 


it 

t « 








»-« *•! 




iM *. m m> t* 
r> #^ t-t « 



o 



a' 
*c 

• J o 
UJ ^ <u 

<r 

** o 

u- o c» 

C- I 

C> <J \i 

I •» I 

I 'J -I 

\. • I 

.... r« •. 

«/1 At 
•L -J Ul 



ERIC 




11- (U . - 







VI 


• i 

! 






t 


1 
1 


■ 1 




1/1 
























it 


























<u 








IP 


r; 


r. 




♦J 










o 


C 


t: 




tJ 










o 


o 




r 










•f- 


o 


o 




c* 




i- 














QJ 








♦J 








l*« 


< 






-J 


♦ J 


4i 






I 








rj 


4 » 


4-* 














iJ 








01 








ij 




rn 




I" 


( } 






t.l 


1. i 








itl 












( ) 


t«l 






r- 






',1 


< > 


Ul 






.■i 


r 




r— 


ti 


o 


f ■ 




•ti 


.It} 


«.•> 








r ^ 




t » 


n 


(J 


i/l 


#>— 




r-« 


:< 


1 1 


I 


( 


I. 










• * 


I 




1. 


(. 

vi) 


•t. 






»; 




"J 


:» 1 


•l» 




• I. 








'♦I 


h) 


I. 














V <ll 


.< 














I. 


41 




ai 








1 




c :i. 


CJ 












1/1 


J* 


:u 


LJ 


{• 




4J 






Q» 


1) 








I.I 






•ii 








t» 


4* 


• J 


^- 


r 




u 




1 








I* 










.1 




<D 




1) 


I. 


( i 


f!' 










< > 


V 






u: 


( t 




I. 


l< > 




•t 
















*1 














Ci 


4' 




jr. St.* 






(.J 




fsJ 


4 > 






lie 






< ) 


ti 




"I 


'•I 








■J 








/•> 












I* 


t 










1 • 


It 




t 
















• 4 




















*•*« 






1 










'0 
















CO 




















> 
















j» 














i 


















r— 


UJ 






1 








1 












m 

























r. f: s 





fij 




QJ 




1 


lA 


I. 

{ ' 






A* 


<D 




f. 




It. 




o 


I . 




in 




«•! 






*i 




X 




ffi 






1 


-1 


U} 






#-* 






CO 
















^' 


UJ 















IV 6 



in 

UJ 



t: I. 
r.i o •♦1 



1/1 rtj 



6 



V. ,1 

i: i; u 

CI II »* 

o < lU 



i: 





.1 






i. 






u 


1 . 








U) il. 




1 










Ql 




i: 




o 


o 










4' 


If-* 




o 






•r- 


•f • 


to 


4-» 


-J 


1 

a 


IT 


4: 


*^ 


O 


o 








- 1. 


*♦» 




o 


*M 










(I 


*» 


-J 


















s 











































i 

•J c 

o o 

O -r- 



o c 



n. 

•41 



It 

h 
r: 

ui 

or VI 



>» r. 
CI o 
r. ■•- 
fl # - 4 » 

J. ti 
I), tj ci 
01 <^ o 

r— lu »- 
t»1 rC 



r 
o 
•o — 
m 4* 

-J i: o 

III V. t> 

ft »ii 



{21 ?i 

^< 

•V ^si v» 



« O 0 

fA hi >i 



ft 



v;) csi 



0^0 

r| < 



I p I 



t\ Si 



111 



!..: 



^"i (j^ 



9 o 



J. 



\ 



i\ ^\ t\ 





r 6 






tA 


4 1 




1 






e 
















u 












J 


4-* *t5 








'il 






I. 


m U 


4 1 






c 








U CI 


••1 






•J 


.V 




4J 


o - 


1 1 


-J 




(<) 


t > 




a 




tj 


It) 






rA 






*r 




i 1. 






.t i 




1 J 












V. 


I* 




•!» 


• c 






••J 


01 

\- 


t 

«i> 




1. r- 


4i 




1 


t/1 


J 


J. 




O 4J 


11 






\l 


1» 




*f 


.1- •»•• 


<U 


in 


C 










t • 


V 


^ - 


I.J 


V. 




f ) 


n» 


<ll 




(/I 




•) 






1 


U 


♦ 1 

i 

t-4 


1 


it 
y 


"J 
t/1 








ERIC 



r 


r 






4J 






r: 










4.> 






u 


r r: ' 




> 








o 


r 
















O (J 




ai 










') 


t J 












4*^ 






a 


'H 


I 




1 * 


















4 1 4J 






< 








4i 


4 J 




1.1 




i« 




i> 






(. 


n 






i 1 


<♦) 






f 


m 






(1 


' 1 LI 


. i 


ri 


(.1 






o 


1 ) 


• 


.-1 




f . » 










t.i 


Q> 






c 




a 


f I 


t 1 J 


• 






t 








V- 


) 




o ^ 








rf 




A » 




f 1 l/> 


»t 




:6 


'^J 


t 


i 


I. t. 


rf 






• c 




f 




^ I 






A. 


o 


»•! 


f»l 


i. 1* 




•V 


•f 




t'.) 


'i» 


'Vi 


I .1 


Oi 










V 


t^' ..* 


Gi 














<J' < 


i 






1 




1 


:i. o 


I" 


,1, 


4 » 




1 


i/> 




.1 ■ » 


( > 


41 (J 






11 


♦ll 








« J 












.1 


«ii 


Ifl 


r 












11 










t t 


( ) 






'J 






c i o: 










o 


L 




f 1 rf' 


01 




il 1 










H 






li 1 












U 11 




i 1 


* - 








tl 


1 1 


tM 


41 




X" 






.t1 I. 




■1 > 










*J 


t 




-•I 










u. 














It. 




I 


_> 






























































\ 












> 
















> 










I 






























«4 #1 


i* !* 






•» 


fa- *< 










IT 









4J 

o u 



c: \, 



^11 



'1 



ERIC 



Hi • 




I. c: 




4* ••• 




i: I 


11 


Cl o 








♦i 




IT 


CA 




v: 


i; 
♦ » 


•»-• 

c 




•r* 




<T1 


H- V, 


i. 




H- 


«i 




t». 


u1 


1 










C 




O 




VI 


41 4-* 


•r* 


|J <o 


rt} 


•»— 


••~ 






« 


r. 


u 


c> 


•r • 


to 


i. ♦J 




O nj 


S 






r: ♦J 




1 o 







f 



.1. c: 
u o 

O -r- 



U SZ 

o c 



nt 
r— 

> 



n 
o 



</1 









i: 






^1 


th 






lU 
















:< 








^> 






t4 




>, c 




UJ 


«u 


♦ ' o 






I ; 






rr- 


o 


• - 1^ 




CI. 


.f : 








• 1 1 


tj <J 


—J 


C> «/» 




•V o 


l«l 


















</> V. 




l9 ^ 




o 




















t: 


O 




u 








M #- 








4J 


r 






<V 1) 


Ci 


o -n 


. i 


11 


I. 




♦.t 


\. »^ 


L" 


at M 




o # • 








* f 




' * . 








• > ; 








"1 < < 







I 1 I I t 



1 



1 ■ ; 



6 . O 



■ « 



!5i 



w --^ ^si <: ^ ^ 



3 



^ 9 O 

>^ "H. v 



I 



1 - 



O 0 



^1 



<u 

V. 























(i: 










f 


















u 


r. 


c: 




>. 


















«* 




















1 










*i 


♦J 




i- 


lL» 








I t 


.-i 






1 


(.1 


'« 1 






f 1 






(tJ 






•» 


t • 








o 


r-' 




t » 




( 1 










:| 




i 




I 


I ■ 










t ) 






w 






»t 


»i 








V 


















1 " 


.1 




I 


• '1 


( * 






lU 


«n 










(,» 


CO 


(. 




it 






( 




n« 




1 1 


V. 




r i 


a" 






V. 


in 


♦J 


*tt 








• ;j 






(.1 












t.» 


ri 














'(\* 




1 


1 












* t 




















0) 


















r ■* 


> 




































M 












4h 


li 



t/l IT 



521 V;\ 

•«» <Jv\ vf. CO rO c^S f~-^ 
<J0 rv*^ C^g Vj^ 

O 0 'rt <) t) <) 



: ...1 

I 



I 



'V) 



til 



if. 



I) 
li. 



UJ 



4J 



(; 

m 



2 









o 


til 1.) 


V. 










41 






3 


(/) 


i 












(> 


















o 


t 






. : 1 1 (. 






r 


iti 




V. 


u 


<M 


1 




t 1 


4 * 


(,"» 




' r 


. * r 1 i») 


I 










.1 


r 1 






r: 








J 






n> 












*» • 


• 1 




*M 


'< i 
















Vt 


) 




< J 




1. 






♦ * 

J 




V 

o» 


» » 


. • » r.t 


t 


OJ 


<. J 


f.) 


J. 


(J 


» ' 


» • 


O 


Q) 
t » 




{ 




1 1 

I' 


I 


I > i'i I 


















ai 
ui 












t ; 


«}• 4 1 




♦1. 




* - 










: J 




1 



(1 
rt. 



u 
a 



». p> 



T ^ 



#-4 



VI •> 
•X. ^ l/l 



It: 



0 

ERIC 



(U r- . 

r. I. u 

ft! U «» 
O < UJ 



^- I- 

4« (II 

Ci. "iO 



a* 

it o <> 
4'* It) tS 



(y c: c: 
o i> 

V. «J .r- 

O rt3 
XI r- -r- 

i: 4-^-1 

Ik. Ut<>3 



I 



3 



O C 
I. -f- 

a. u. 

g 

♦J 



> 

Ui 



c 
o 



u 



a 







c 










UJ 






rr 








1/1 d) 














to 






UJ 






••4 


n» 


o 


ri: 


t. 




• C 


o 


u 




a.. 




. J o 


r- 






41 


C) 


f , 


»— 


t J f • 


: : i. 


H' 




it 4» o 


1 - 


< 








U-- O 




c: 


o < -> « » 




o 






•o r. 






ni 






at n> 




.J 




i * V 


I.I 


V o 


C 1 J 


< 


-u — 




:< 






•1 





501 



t t ( t : 



5^ 



Si I 

I 



r>4 



51 



\ 1 



^1 



05f 




N St- c>- 



4 



^1 















t 


J 










o 


LJ 


r 


















I. 




at 


4*i 


>, 


4 1 




1' 










i: 




4 ' 




f • 




n 


( i 




I 




o 


to 


f \. 


«. J 








1 1 










t > 




1 














i/j 








m 


"J 


X 




>• - 




r» 






1 1 






t u 


rsi 






1. 


^.» 


1 1 




r - 














♦ f 


( I 


,t . 




•4- 


fk 






t 












1 


C ) 






O 




























1 














I 








M 






Mi 







f » 
(1. 



1 1 M 



t 

Q» 



in 1/1 



C 

4'j 4 





i. 




0 




Ui 


V 












0 










/• • 


f .■ 


►4 




rj 










f 




«r 






:c 




1 












0 






•C 


•C 




1 








1 




-C 






4) 














\A tU 






4> 


f 


t 


>i 


4i 






1/1 




^\ \ 


t.l 


1 




At 


ti' 


ij 


«i 


1 ( 




#^ 






*♦! •/ 


' ) 




4 V 


( J 








0' 










( ) 










1 


( ) 




i 


01 


> 










1 • 






* * 






• ♦• 


f • 














•»*• 


n 




(J 




*i 


r ) 






•tl 


* J 


f ■ 




t' 1 




1 ' 




1 

* -4 


1 


\> 
i 1 






J 




a» 

^♦ 


i.. 












CO 






1 






i 






































c r~ 


fk. 














4 


• 1 


lA ^ 

« ■ t« 




# . 


-» 














V 



X 



ERIC 





-1 


'0 


<». 


t- 






o » ♦ 


4 » 


'J 




V> 






1 












t: 


c 




o 


o 










Ij 


•f— 
















Ti 


rj 


1 


c 






o 










w. 


Ti 






<« 




n.j 






c: 


♦J 




i» 


o 




lu 


U>«1 



o 















i.i 






n 




»--« 






O 




ci: 




t" 






ir 




o u 


« J 


_ i 


CI 


i/> 




« ) 




4 > 


Qi 






r 











•♦J 4J 



I ^ lil . - 



8>1 



•til 



I? 



CI 



•41 



^1 



5^1 



'4 



O 



iA 


















, t J 
1 




1 




f~ 

f- 


♦ * 




r 

L» 


r* 

f> 


I 


•*•» 

4 * 


4' 




' t.^ 


Ql 




r f. 

f 




•«« 






« J 


( 1 




U.. 




4 ' 






•. 




11 
t 




«i 

ITS 


• i 
1 1 




I 

) 


11 
I 




»> 


\> 




^ 1 t 

t 1 1 ■ 


0' 


■1» 




I > 


1 > 


'0 




ill 






fl. 




UJ •. - 


rl 




o 






1 


£.i 




t1 






o . 


f-' - 1 


■' t 






• f 




( / ' » 


1} 






o 


^- • 


»" • f 


• C 


i: 


f'% 




• i: 








t: « ' 


V . 


CL 


« r 


»1 1 


' 1 




a* 




*♦ 1 


M 




(J >*i 




ft 


•A 








Oi 










•f ( . 






r.i t,\ 




1 










«/» 


*»! 


4 • 




(/> I 






( ) 


• 1 


« J 






01 




rj ♦ 
1 > . 




» 4» 

f ' • 


in r.i 












' '-Xy 










( i .* 


V- 




1 1 








\ 








v> 


( 1 • ' 


r . r,« 


-1 
















• i 




V I J 






r • 




'J 














f - < 1 




rl 




at 
















»»- 


•II •~\ 


1 • 

1 1 






\ • 


I.. 


t 4 








i 1 






\ v.. 



551 



N ^ 
r>i i>J 



Si 



u 
o 



























o 














r 




4'> 














tj 








c 




1 






r» 


m 




t/l 








4 J 






. J 










\a 


n I* 




o 


1. i 


I* 






Cm 








r 


o 


l1 


A » 
























t X 








« 1 


ni 


1 • 1 t 


'ri ! 






( > 


4i 




'♦I 




ni ^ 














</» 










<li 


O 










<V j 


Cj 
t i 




i-i 


A' 

i. 


r , 

e~i 

C 1 


* * 


I 
-J 




1 




4 » !■ 


(1) 


X\ 


ir 1 


I . 






C3 . 1 



1/^ 



ft u 
»- V. 



to 



« R V 



1/1 LJ 



ERIC: 



1- 
(ti 
I 



I: 



iiv: 

•r- •• • 
U 1. 







♦ » 


Qi 




1 


«* 


O 






CI 


o 


t * •* 










«o ^ 














t 






O 
















. . . 


\ • 






C$ r- 




CO.' J 


c: 




o 




















^-. 




•r- 




O 




c 
<ll 








:> 


c 




u 


o 












4J 


u 


rj 




u 


.tl 


n 


v» 


* XI 




o 


c 







o 



> 

U4 



44 



1 







































t: 










o 










» 

I*. 










c-» 








UJ 










cr. 


1/1 








l£ 


1/1 
























tii 




di 




c 








o 


a* 




«• 






•■il 














. J : 




.« 


-J o 




ri 






i«j 




Q» 


-J 


6 


o: 






u. 




tA 




a 








t> 






't 


«/> 


♦ T, 








o 


(1> 






cr 


O o 


«> 






o 












4-* 






4* 


f V- 






f.» 




m (, 






i 





^1 



^1 



51 



... o ^ 



l/\ ts^^ 

^ ^■ 



0. 0 



O 





r 




4* 


» r 










« - 1 




f > 


«^ 

ii 


f » 

r i 






Tr 


at 




nt 

t ) ' » 






C 


.ti 






4J 




ri 




t ) 




1» 


t » 




1 • 






ro 




1 1 


t 

ai 


i. * 
« ♦ 


1 1 




<ii 

t 


^ » -f' 
< 1 \ 






( > 














» ■ 111 








(1 


< 






ti 


» 1 


V/l .— 








.-5 






'ft' 


•*» 










1 






1 




> 4 


» 1/1 







fi. 

























r 


o 












tz 






o 




c 










o 




> 






O 












o y 


QI 




'0 












♦ > 








•J 

o 


♦ J 




1 






1 1 


♦ i 4^ 

A) ftj 




o 




u 










o 


• J 1 J 








o 












C) (3 










lij 


■ 1 


r 


4 ^ 














(r 


t 


■'•1 


















• 'tj 


1 










a» 










i 


















•t' 1/1 


f i 




r 


-**4-* 




(J 


< ' 








* J 


to 




♦ ' •> 


1- 


.1 








• » «<*- 








.- u 




fi 




C. 










< ». 


♦ • k. 














(J 




<ij 








t J 


T> 


r J 


f ^- 






i*~ 


VI '1 




> 




I.' 


1 }\ 


r, 






11 


••1 i 




t 




*^ 4 


1 


» in 











I' 



-1 



i 



1^- 



ERIC 



t. c 

CJ 

^» \i 
O U" U4 



c: O 



oj «: c 
o o 



QJ C C 

o o 

o <o «u 
•u •» • 
c; ~i 

.1 o 



o 



lie 
u o 
o 

CI *J 



g 



o 



a 



41 



r 
L 



to 


>> c 


l«J 


GJ O 


♦^-•« 


t: r' 


f f" 












o «/> 


a> <j o 








'i * »— 


:•; I 


M 


2t cj 








»♦ r> (u 


r: 




o 




1) 




«J 


r V. 




<U o 


,1 f ■ « 1 


I. V 


111 V. o 


t -» -J 


( 


tr . t» 




« J I . 




^ / » rj 




fT r-. ♦J 




*% 





§1 fii ■>! M 

fvi iM v>N *N M . >J *^ 

Vj f »^ Q •> M »i 

ti N '^ ^ ^1 o| 

. . . . : 



9 



r: J s s V 
^ I 



0. 



^1 ^> <N 



I 



$irji rii 

i.'i w ^t 

.-^ A| <li 
W j 



^« ^1 3» ^1 ::i 



W ^ 



^ 



CO -si 



tl ^1 ^ 9 ft 
i :^ ^- V si 



I 

"} > t 





















i'i 






-.1 






















I. 


Ui 














'•1 








o 


Ct* 


I. 




















•w 


11 
















**- 




'J 




» J 


i; 


•n '•J V- 








♦ 


1 

«•> 


O 

I' 
t » 




St 

( 




t 




.■' * ' y 






t" 




( 






UI 


• 










C> 






. J \ 


<• 


V- 




C 


4* 








( 'i 


I • 




L 








1^ 


O 


.1 






'•1 






r. 




ai 


• 


1 1' 


I i 


• / :u : 






:i: 


U 


J.' 








<."> 


•» 


















fi: 




r i 


* t L. 




















< 1 


• 1 




UJ {1. V - J 


o. : 


<4 




fj 


f • 

















o 






1 














4.i 


Ci 
























c 




?. 






















a> 












Q> 








C'J i»» 




•ti 


* J 


tl 












♦ i 






••^^.^ 








CL 










r 


(/) 
















> • 








li 


1J 




iA 


>> >i 








JJ 










r L 


:c 












jC 


























u 






(/) 






i.i 
















n 


r 


i* 




r 




( J 




1 1 


•} •! 




•u 


V. 


c 


^\ 


t:» 






01 


























1^ 






-> 




w. 


tl 














1 


I 


'■t 


U) 


1- / ■ 


» ■ 


( -J 


. 






j: 






'.J 


m 


J 




«-> o 








?; 


i i 






u 


I 






(U 


v.. V 


V. 






















'J 






♦ - 


4 1 


r 


'»'. 


li. 








Cl* 






.c 






(/) 


V 








i: 










4 i 






(J 










'J 










r 1 






a. 

t 








1 


















f: t 





























Ui 






< 1 . • ♦ ■» 


cr 






f t. » J « 1 




Of CJ 


.J- t> 1/. 


u_ . - 








h- t-T c-C 


~< ' > 




« • o 












O « i .^ 






ri ♦J 


♦ J >.• J 


Qi • t 




- J • » > 

I'l .. O 




r 1 •;• r - 




. ". I J * 1 


•• ' • I" 
It -1 




1 » 




»f J a> 






ERIC 

























f > 




I i (-1 
















CI 






' > ' > 








1 












<. J '-I 












«)t 






J t: 
















r 




n o 














C 


11 






t r 


















4i 4* 


«^ o 




f 






» ?^ 


4* 


4 ' 


4 ' 


/II 














{ 




•1 


'J 1 1 


4 ' > ' 




1 








I ' 


















A* 




• ^ 








.J 


« I. 


4 J 




<j 










< » « » 


1 1 J 




t 




CJ 








*r .1 








'J 
















' '« 






i1 










•r. 












t«'i 




CI 


ft* 






V- 


♦ J 


♦ ' 






( 






4 » 4> 






(' 






» 


I » 




1*4* 


1 1 1 1 








t: 


o 


t -» 


1 


i 




-.1 -li 


r 1 


• 


t' 




nt 


( 1 


( 1 




» ♦ • ■* 


1 V. 


r ' 1 




t L 


» 1 


u 


' J 


« 








( 1 


• \ 




1 




o» 


»•- 




I J \i 


DM 


(^i 




1 


f> 


ti 






••t 


n ..1 


1 t . 






( t 


ij 


I . 


1 


» • 


I • 


1.. IL. 


» > f 4 


1 




tiJ 


'. J 
























<«J 










'•> 


< > 




























r— 










t * 














#1 


<0 *• 























t ^ 

; n 








f 


• 4-> 








■>« 


1 o 








t' 


t" 








y 












4 1 






a 


!'.: 


o 




4 * 


u 


''J 


1 












4 1 




<\> 


. CM 




> 1 






J 


J 


/ 


1 < 




1 t 

( ' 


t) 




, C 




ft 


( > 






u.' 










4 





n-13 



Column 6: Assignment of NWREL Allocation to ARIES 

Evaluation Category 
Column 7: Assignment of NWREL Allocation to ARIES 

Product Finishing Category 
Column 8: Assignment of NV^REL Allocation to ARIES 

Documentation Category 
Column 9: Assignment of NWREL Allocation to ARIES 

Diffusion Category 
Column 10: Assignment of NWREL Allocation to ARIES 

Fundor Negotiation and Liaison Category 
Column 11: Assignment of NWREL Allocatioji to ARIES 

Site Negotiation and Liaison Category 
Column 12: Assignment of NWREL Allocation to ARIES 

Staff Recruitment and Training Category 
Column 13: Assignment of NWREL Allocation to ARIES 

General Clerical, Administration and 

Housekeeping Category 

When reporting personnel' costs , columns 3 through 13 
contain dollar figures entered to right and person days 
to the left. Chart I-ll presents the NWREL totals for 
each column in line 20, the totals of all indirect 
allocations based on prorations and all direct allocations 
are reported in line 21. Line 24 records the assignment 
of rent payments in excess of one month to rent reserve. 
Line 26 is the total of all NWREL costs. 

Ch&rt II contains the following categories: 

Column 2: Total for Assignments Prorated According 

to Convention by CE2 
Column 3 1 Assignment as reported by CE2 
Column 4i Assignment of CE2 Allocation to ARIES 

Design Category 
Column 5 1 Assignment of CE2 Allocation to ARIES 

Application Catecjory 
Column 6: Assignment of CE2 Allocation to ARIES 

Evaluation Category 
Column 7: Assignment of CE2 Allocation to ARIES 

froduet Finishing Category 
Column 8: Assignment of CE2 Allocation to ARIES 

Documentation Category 
Column 9: A.ssianmGnt of CE2 Allocation to ARIES 

Diffusion Category 
Column 10: Assignment of CE2 Allocation to ARIES 

Fundor Negotiation and Liaison Cat'^gory 
Column 11: Assignment of CE2 Allocation to ARIES 

Site N<r>goti ation and Liaison Category 
Column II; Assitfnmont of CE2 Allocation to ARIES 

r»taff Recruitment and Training Category 
Column 13: Assignment to AR] FS General Clerical, 

Administration, and Housekeeping Category 
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V/.illi rcr^noct to cost aasjicjnmonts hy CE2 based on 
proration convention, Column 2 qivos the tota] cost to be 
prorated and Colunn 3 gives the proratcnl amount by CK2 . 
The remain inq columns report ARIES assiqnment of the t otal . 
Thin wil l 1-1. > the cny.o for the firrit entry of the pro- 
rated item;; by CK2 . For all subsequent cntrien of pro- 
rated quantities by CE2 as reported in Column 3, there 
will be no entry in any other columns. 

Again, the final page of Cliart ll, Chart II-6 
presents totals: Line 33 reports CE2 column totals for 
Columns 3-;i3. Lint^ 34 reports MWREL Column totals as 
transferred from Chart I - 11, line 20. Line 35 reports 
totals of the entries in lines 32 and 33. Line 37 reports 
tlje Kent Kuserve Allocation. The total of all NWREL and 
CK2 exjienditures is given in line 38, The percents that 
the sum ot r.'WREL and CE2 costs in eacli column is of total 
costs exclusive of Rent Reserve are reported in line 40. 
Line 41 reoorts the rank of each ARIES standard report 
category. Chart III summariiies the data from Chart II. 
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CHART III 



Costs Directly Apportioned 
To ARIES' Standard Report 
Categories 



Cost 



Category 


Apportionment 


Percent 


Rank 


Design 


6,426.02 


10.1 


4 


Application 


14,735.23 


23.1 


1 


Evaluation 


7,791.28 


12.2 


2 


Product Finishing 


4,231.76 


6.6 


5 


Documentation 


832.16 


1 3 




Diffusion 


4,007.79 


6.3 


6 


Fundor Nec otiation 


& Liaison 6,660.62 


10.5 


3 


Site Negotiation & 


Liaison 295.54 


0.5 


10 


Staff Recruitment & 


Training 303.19 


0.5 


9 


General Clerical Administration 

and Housekeeping 3,557.61 


5.6 


7 



No allocation of NV\^REL Operational Costs were made to 
ARIES suggested program component categories, since CE^ 
staff were not available for interview. 



Even had they been so, it would be apparent that 
refinement based on memory would be meaningless. The 
categories suggested by ARIES are admitted to be a best 
first approximation only. Their application in practice 
v;ould require extensive interaction with staff. In the 
process categories and definition would change. A hasty 
interview, even if permitted, would not allow for this 
process. At best the results could only be extremely 
rough approximations. In any case, the interviews were 
not permitted. 

Based on this data at hand, ARIES has derived 
estimates of the annual per pupil operational costs. 
These are derived from costs as reported in Chart II. 
The follov;ing Chart IV shov^/s the process. 
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Figures from linos (1) and (2) of Chart IV, are 
taken from the column totals of Chart I and Chart II. 
Line (3) allocates the two NWREL indirect categories 
(Telephone and Facilities, Indirect) to SRT/GA. In 
line (5) a share of the total cost assigned to SRT/GA 
is allocated to Design, Application, and Evaluation 
respectively. Line (6) gives the totr.l cost March 
estimate for the throe Standard Categories. Assuming • 
that March is average and that there are 9.5 months in 
the school year, the month figures are converted into 
annual figures in line 7. Rent for the CE2 facility is 
recorded in line 8. 

Line 9 records an annualized equipment charge. We' 
assumed $20,000 in equipment purchased over a 5 year 
period. The price plus interest total cost estimate 
was $25,000. This figure v/as depreciated over a five 
year period giving $5,000. 

Line (10) records the totals of lines (7), (8), (9). 
The lov;er estimate of annual operating costs is the 
application total, or $172,381. To obtain the upper 
estimate. Design plus Eva].uation for CE2 staff is added. 
This is found in column (1) line (10) . The upper 
estimate is $212,851 found irj line (12). 

These are converted into per pupil annual costs 
in Chart V. We assume no increase in cost for student 
enrolments beyond 64. This is simply ARIES informed 
judgment. 

It should be noted that CE2 enrolment v;as 50 
students for school year 73-7 4, and that CE2 plans an 
enrolment of 64 for 74-75. ARIES feels that present 
staff size and facility cost could accomodate enrol- 
ments in the range of 7 5 to 100 if all research and 
development activities »«»«»rp pr»«!ent. 

It should also be admitted that all building and 
equipment costs have been included as an operational 
cost (Chart IV, line 9). If purchased outright prior 
to operation, these costs would be acquisition costs. 
The service costs of acquisition would be increased 
by that amount. 

Finally, no adjustment has been made to account 
for the difference between salary and benefits paid 
staff in developmenta] project as that to staff in a 
adopter setting. No thorough analysis has been done, 
but ARIES has looked at daily compensation scales at 
NWREL/CE^' These, v;c feel are on the average of 5% 
in excess of adopter staff salaries. 
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4.0 



Conclusions 



4.1 It is the opinion of this paper that the 
categories of Standard Reporting make for more 
accurate and more useful reports, "^'For example^ 
in the absence of ARIES categories 

(a) Costs of the same activity would be 
allocated among differen t report 
categories. For example^ activity 
allocated to professional meetings 
would be reported to. Evaluation for 
personal costs and to Program Admini- 
stration for travel costs. 

(b) Costs associated with the same signi- 
ficant activities for which no defined 
report category exists at present are 
reported among different activities. 
For example y there is no provision 
for classifying activity due to the 
reporting needs and other tasks imposed 
by NIE itself. Ilence^ the associated 
costs were found to be allocated to the 
primary category to which personnel are 
assigned^ e.g., Product Finishing, 
Evaluation , etc . 

(c) The large residual category of Program 
Administration which under current 
practice would account for $10,599 

and 17% of cost is subdivided into three 
specific categories and a final residual 
category for better specification and 
analysis of cost. 

4.2 The recommendation that rough estimates of 
per pupil employ an upper and lower estimate, the 
upper including Design and Evaluation in addition 
to Application Costs (which defino the lower esti- 
mate) should be abandoned. Based on the expert- 
ience^ of this investigation the upper estimate 
would* be double the lower estimate. ARIES feels 
this range of difference is excessive. Based on 
the experience of NWREL analysis, the upper esti- 
mate should include the design and evaluation 
contribution of operational personnel only. In 
this case the upper estimate would exceed the lower 
by only 26%. 

4.3 The recommendation of the prior report that 

proration bo avoiclod v/horcvcr po5:rjiljlc is amplified 
by the presence of what appear to be arbitrary 
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proration schema in tho CE2 cost allocation systera. 
Prorations of th?se kinds contain assumptions 
concorning the impact of each activity to which 
cost is prorated upon the behcwior of costs when 
the level activity is changed. For example^ if 
the proration is 20% Development^ 40% Operations- 
Instructional System^ and 40% Operations-Logistics 
(using NWREL categories) > the implication is that 
in the absence of Development cost would be re- 
duced by 20%. This may be true in some cases ^ for 
example^ the quantity of duplicating paper. How- 
ever, it may not be true, for example, in the case 
of equipment such as duplicating machinery. 

4.4 In a related matter, for discussion of repli- 
cation requirements and cost, the most useful 

data is (a) specification of the resource quantities 
required by the program in their physical, non- 
monetary dimensions and (b) description of their 
allocation cunong various component elements of 
the program during the annual (or other) cycle of 
operation. If this is done the adopter of the 
program is free to exercise his ov/n judgments con- 
cerning full or partial utilization of resources 
and the associated costs based upon his own parti- 
cular site conditions. 

4.5 One staff suggestion was that evaluation be 
viewed as a product instead of an activity only. 
In this case NIE would report the costs of design, 
application and evaluation, etc., of evaluation. 
This suggestion, on the part of evaluation per- 
sonnel should be given consideration, since by in- 
clusion one gives specific recognition to the 
importance of evaluation as an operational activity. 

4.6 One recommendation has nothing to do with 
the NWREL cost system. ^3WREL staff reported that 
they could only report time to those categories 
for which they were budgeted. This policy was 
ascribed to NIE. Such a policy either promotes 
inefficient operations or inaccurate reporting. 
Staff should be free to report their time to 
categories v;hich most accurately describe their 
actual v;ork. A policy v;hich requires otherwise 
should bo changed . 

4.7 Finally, NIE must require specification cost 
collection system in the early stages of research 
and dcvolopmont programs. This will mean that 
cos t quo ?^jtio m; be clearly formulated early in the 
project. It is Loo often the cajjc that cost matters 
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arc loft until late in the lifetime of the program. 
The result is that cost questions are unanswered 
and/or that nov/ reporting requirements are imposed. 

It will usually bo the case that such a system 
will be considerably more detailed than those now 
employed. Such a system may be thought foreign to 
educational researchers and onerous to their staff. 
However, it is likely to achieve better accept- 
ance in the long run since staff will be freed 
from adjusting to the continual introduction of 
nev/ systems of increased detail. Such a more 
detailed system will, of course, be much more 
adequate to providing the kind of cost information 
ultimately desired. 
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EXHIBIT A 
Cost Category Translation Matrix 



The chart which follows indicates the relation- 
ships between the categories used by NWREL, NIE, and 
ARIES. The basic ARIES categories which describe 
research and development are listed as headings to 
columns 2 through 11. NWREL and UIE categories are 
listed vertically. So too are ARIES product and 
product component categories. For each non-ARIES 
term listed as a rov\7 heading an indication is given 
in column one v/hich identifies the system of oricrin. 
For any non-ARIES row heading, a circle in a column 
heading indicates that the row term is classified or 
divided among the column headings so indicated. If 
ARIES product. or product component categories apply, 
those appropriate will be listed under the NWREL/NIE 
term in the left hand margin. It should be understood 
that this always implies that the quantities trans- 
posed into ARIES research and development categories 
be further divided into appropriate ARIES ^product and 
product component categories. Tiiis will be indicated 
by a dov/nward directed arrow. 
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EXHIBIT A 



Cost Catogory Relations 



Tho pages which follow describe the relations 
betv/ecn NWREL categories and ARIES categories. In 
that sense, the contents are a companion document to 
the Matrix. However, this document indicates v;hich 
material is available from present cost records 
and which must be gained from interviews. Material 
that can be transposed from one NWREL category to one 
ARIES category requires only an analysis of available 
cost record. Material that must be transposed from 
one or more NVJREL categories to one or more ARIES 
categories will generally require interviev/s in order 
to make the divisions required under the ARIES system. 

In each case, the discussion is organized v;ith 
NWREL categories as the starting point. For each NWREL 
category, an instruction is given for translation into 
the ARIES category or categories which describe research 
and development cictivity. Then a second instruction is 
given for translation into ARIES product and product 
component activities. The basis of v/hether cost records 
and interviews are required in order to execute the 
instruction is given below; 

(CR) Indicates that translation to the ARIES 

category can be accomplished on the basis 
of present original cost records . 

(I) Indicates that the present data will need 
to be divided into, or among, several 
categories and that interviewing will be 
necessary. 

A. Development - Governance 



Allocations to this category are to be transcribed 
directly into the ARIES categories of DESIGN - 
GOVERNANCE (CR) 

However, these allocations should be detailed into 
those of 



1. FORMATION OF THE GOVERNANCE UNIT AND RECRUIT- 



B . pevolojpment Management 

Allocations to this category transcribe directly into 
DESIGN (of EBCE Program Administration* (CR) 




MENT OF MEMBERS 



UNIT OPERATION 
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One problem iy that the NIE system maintains a cate- 
gory for Log is tics (which in turn contains (a) trans- 
portation, (b)" insurance and legal service, (c) health 
services, (d) phone and utilities, and (e) other, to be 
specified) under opei ations. No siicli category (s) 
exist under M\\'REL*s Developnent or Evaluation^. Are we 
to believe that these services were neither designed 
nor evaluated? If they are, then when under NWREL 
Development do they find a place? Management? If so, 
then NWREL Management will have to be detailed as 
follows: 



1. EBCE PROGRAM ADMINISTRATION 

2. BASIC STUDENT SUPPORT SERVICES 

a. TRANSPORTATION 

b. INSURANCE 

c. HEALTH SERVICES 

d. OTHER - SPECIFY 



C. Development - Instructional System 
Allocations to this category transcribe directly 
into DESIGN - BASIC SERVICES - EXECUTION. (CR) 

However these allocations should be detailed into 

1. EXPLORATION LEVEL 

a. BASIC SKILLS 

b. LIFE SKILLS 
C. CAREER DEVELOPMENT 

2. LEARNING LEVEL 

a. BASIC SKILLS 

b. LIFE SKILLS 

(I)^ C. CAREER DEVELOPMENT 

3. SPECIAL PLACEMENT (SINGLE OBJECTIVE) 

a. BASIC SKILLS 

b. LIFE SKILLS 

c. CAREER DEVELOPMENT 

4. SPECIALIZATION LEVEL 

a. BASIC SKILLS 

b. LIFE. SKILLS 
C. CAREER DEVELOPMENT 

D. Dievelooment - Guidance 
Allocations to this category transcribe directly 
into DESIGN - BASIC SERVICES (CR) 

However, these allocations should be detailed into: 
ORIENTATION 
LONG PvANGE PLANNING 
SHORT RANGE PLANNING 
PROGRESS MONITORING AND ASSESSMENT 
STUDENT PERSONAL AFFAIRS AND PROBLEMS 




ERIC 



E. DovclopiTicnt - Employer Ut.lli ;^.ation 

Allocations to this category transcribe directly 
into DESIGN (CR) 

However, these allocations should be detailed into 
COMIvlUNITY RESOURCES. 
(I) Tl. RECRUITMENT, ANALYSIS AND DEVELOPMENT 
V2, MAINTENANCE 

RECRUITMENT, ANALYSIS, AND DEVELOPMENT refers to 
all activities, involved with securing initial 
participation of community resources, with sub- 
sequent analysis of their enterprise in terms of 
its potential, with identification of specific 
individuals, but not including the activities 
specific to designing and negotiating specific 
projects for known students (other than re- 
quired recruitment of a new employer to satisfy 
such a need. ^ 



F. 



MAINTENANCE refers to all activies involved obtain- 
ing the continued commitment of the resource to 
the EBCE program. 



CE^ Development 



This should be 
be detailed as 



assigned as 
1-5 above. 



ARIES DESIGN. It should 



G. Evaluation 

Allocations to this category transcribe to an ARIES 
category of the same name, EVALUATION (CR) . 



to allocate 
the objects 



However, v;e should seek 
allocation effort among 
These will include: 

Governance (CR) . Divide into: 
FORMATION AND RECRUITMENT 
UNIT OPERATION 
Management (CR) . Divide into: 



the total 

of evaluation. 



1. 

(I) 
2. 



/a. 



(I) 



3. 



(I) 



1 



r'a. ADMINISTRATION OF PROGRAM 
b. BASIC STUDENT SUPPORT SERVICES 

(1) TRANSPORTATION 

(2) INSURANCE (STUDENT) 

(3) HEALTH SERVICES 

(4) OTHER - SPECIFY 
Instructional System (CR) , Divide 

a. EXPLOI^TION LEVEL 

(1) BASIC SKILLS 

(2) LIFE SKILLS 

(3) CAREER DEVELOPMENT 

b. LEARNING LEVEL 
(1) BASIC SKILLS 



into: 
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(I)< 



4. 



5. 



(I) 



(2) LIFE SKILLS 

(3) CAREER DEVELOPMENT 

c. SPECIAL PLACEMENT (SINGLE OBJECTIVE) 

(1) IJASIC SKILLS 

(2) LIFE SKILLS 

(3) CAREER DEVELOPMENT 

d. SPECIALIZATION LEVEL 

(1) BASIC SKILLS 

(2) LIFE SKILLS 

(3) CAREER DEVELOPMENT 
Guidance (CR) Divide into: 

a. ORIENTATION 

b. LONG RANGE PLANNING 
C. SHuRT RANGE PLANNING 

d. PROGRESS MONITORING AND ASSESSMENT 

e. STUDENT PERSONAL AFFAIRS AND PROBLEMS 
Employer Utilization - Community Resources (CR) 
Divide into: 

a. RECRUITMENT, ANALYSIS, AND DEVELOPMENT 

b. MAINTENANCE 



the 



H. Operations 

All allocations to this category transcribe to 
ARIES category of APPLICATION (CR) . 

NIE has established subcategories within operations. 
They are considered in order: 
1. Enabling (I) 

a. Staff and Student Selection (I) 

This NIE category must be divided into: 



(1) 



(I)< 



b. 



Student Selection which is to be 
assigned to ARIES APPLICATION and 
then to STUDENT RECRUITMENT within 
that. 

Staff Selection which is to be. assign- 
ed to ARIES STAFF RECRUITMENT AND 
TRAINING. 

Staff, Student and Community Orientation (I) 
This NIE category must be divided into: 



(2) 



(1) 



is assigned to the 
STAFF RECRUITMENT 



(I) < 



(2) 



(3) 



c. 



staff Orientation 
ARIES category of 
AND TRAINING 

Student Orientation is to be assigned 
to the ARIES category of STUDENT 
ORIENTATION. 

Community Orientation - (This needs to 
be defined. My thought is that this 
is to be assigned as the ARIES cate- 
gory of SITE NEGOTIATION AND LIAISON.) 
Employer Recruitment, Orientation and 
Development (T) 

This category is to he assigned to the 
ARIES category of COMfWMITY RESOURCES - 
RECRUITMENT, ANALYSIS, AND DEVELOPMENT. 
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2. Instructional System (I). 
This cntoqory of activity is to be assigned 
as the ARIES category of APPLICATION. It 
should be divided into: 

a. EXPLORATION LEVEL 

(1) BASIC SKILLS 

(2) LIFE SKILLS 

(3) CAREER DEVELOPMENT 

b. LEARNING LEVEL 

(1) BASIC oKILLS 

(2) LIFE SKILLS 
(I) J (3) CAREER DEVELOPMENT 

C. SPECIAL PLACEMENT 

(1) BASIC SKILLS 

(2) LIFE SKILLS 

(3) CAREER DEVELOPMENT 
d. SPECIALIZATION LEVEL 

(1) BASIC SKILLS 

(2) LIFE S7ILLS 

( 3 ) CAREER. DEVELOPMENT 

3. Logistics (I) 

This category i/. to be divided into the ARIES 
category of DIRECT SUPPORT SERVICES within 
APPLICATION (I). 

Phone and utiliti'.r. pre to be deleted as 
categories of service or component activities, 
These ^re resourjes and are to be assigned 
wherever possible. 

4. Major Fixed Costs 

This category is not to be defined as a 
service category. It may or may not be 
allocated as a resource among the several 
categories of service and function. 

5. Program Administration (Operations) 

This NIE category is to be assigned to the 
ARIES category of EBCE PROGRAM ADMINISTRATION 
under APPLICATION. (CR) 

NWREL Dissemination 

Allocations to this category transcribes two 
activities: 
/jx 1. REPLICATION/DIFFUSION 

2. FUNDOR NEGOTIATION AND LIAISON 
Dissemi nati on is a NVJREL categ:)ry which means 
simply talking v/ith and rendering services to 
outside visitors. 

FUNDOR NEGOTIATION AND LIAISON (FN & L) is an. 
ARIES Ccitegory (see Report, p. 36) which refers to 
activity imposed on the contractor by the fundor 
but wJiich does not per-tuin directly to accomplish- 
ment of the research and development project. Pre- 
paring proqress reports, negotiations concerning 
nature of work, and assisting NIE contractors arc 
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all illustrative. In the case of DBCE, Dissemi~ 
nation is considorod as FN & L when visitors are 
NIE, NT.E contractors, or jovernment agents \\'hose 
duties are derived from NIE (e.g., G.A.O. audits). 
REPL.TC/M'ION/DIFFUSION is an ARIES category. (see 
Report, p. 36) It encompasses all activity directed 
toward facilitating adoption of the program or 
materials under development. NVJREL Dissemination 
will be classified as Replication/Diffusion when 
it involves persons and agencies other than those 
directly associated with the fundor. 

J» CE2 Dissemination . 

Allocations to this category are to be treated as 
NWREL Dissemination (i) . 

K. Product Develoi^ment 

This NWREL category transcribes directly into the 
ARIES category of DOCUMENTATION. (CR) 

L. Program Administration (CE2 + NWREL) 

This category should be divided among four ARIES 
categories : 

r 1. FUNDOR NEGOTIATION AND LIAISON 
(I)] 2. SITE NEGOTIATION AND LIAISON 
] 3. STAFF RECRUITMENT AND TRAINING 

»-4. GENERAL T^ANAGEMENT , CLERICAL AND HOUSEKEEPING 
The following are NWREL categories that may or may not 
be assigned to the services and functions of the EBCE 
program. In ARIES terminology they may be secondary 
research and development products. 

M. Cost Studies 

Student Recruitment (by School District 
resources) . This should be assigned to the 
ARIES category of APPLICATION and, within 
that, to Student Recruitment (I). 

2. Testing of Control Group. Students . 
Allocation of these resources should be 
assigned to ARIES category, SECONDARY 
PRODUCT: SPECIAL STUDY I (I) (This is an 
issue. An alternative is to assign to 
Evaluation. ) 

3. Study of Community Resource Costs. 

These resources should be assigned to SECON- 
DARY PRODUCT: SPECIAL STUDY 11 (I) 

4. Service Modification Cost Study, 

These resources should be ossigned to SECON- 
DARY PRODUCT: SPECIAL STUDY III (I) 

5. Installation Study, 

Tlicse resources should bo assigned to SECON- 
DARY PRODUCT: SPECIAL STUDY IV (I). 
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N. Hop 3. .'i ca t ion 

1. Prospectus 

This category should bo assigned to ARIES 
category, FUMDOR NEGOTIATION" AND LIAISON (CR) 

2. Phase I 

This category should be assigned to ARIES 
category , REPLICATION/DIFFUSION (CR) . 
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Definitions 



A. LONG IVvNGE (PROGRAM) PLANNING 

Activity associated with assembly of baseline data 
(tests^ student records^ interviews)^ and its 
employmGnt in order (1) to determine goals for 
'program completion and beyond that for career pro- 
gress (2) to assess the initial state of the student 
with respect to program and life goals ^ and (3) 
to choose a tentative sequence of actions which/ 
over the period of the program^ will maximize 
student progress toward goals so specified. 

B. SHORT RANGE PLANNING 

Activity associated with assembly of data and its 
employment in order to determine goals for the 
school period (semester or quarter) and choose a 
sequence of action^ complete with detailed speci- 
fication of the next immediate steps ^ which will 
maximize student progress over the school period. 

♦ 

C. EXECUTION 

Those actions taken by staff to implement short 
range plan by negotiating learning tasks facili- 
tating student placement in learning environments ^ 
and rendering assistance and guidance in task 
completion. 

D. PROGRESS MONITORING AND ASSESSMENT 

That activity taken to collect information needed 
for determining student progress in accomplishing 
specific tasks and to employ the data so gathered 
in evaluating student progress toward short term 
and program goals. 

E. PERSONAL AFFAIRS AND PROBLEMS 

Those activities specifically taken to identify 
and improve student personal problems and their 
effects . 

See Paqos 27 - 30 of Final Reoort, (Revised) 
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Schematic Posscription *of V?ork 



The diagram which follows summarizes the work flow 
required to accomplish the task suggestion by NIE. 
Assuming choice of an appropriate period of study, 
the first step is to break costs down into the resources 
allocated to the period by MWREL category. This can be 
done by working through the present NWREL system: 
One can start v/ith reports for the period, secure a 
printout identifying transactions for the period by 
NWREL category. Such a printout permits identification 
of the source documents, such as time sheets. Each 
document states the MWREL account to which it was 
charged (there may be more than one). The result is 
a statement of physical allocation to NWREL category. 

The task is to reorganize these into ARIES cate- 
gories. To do so, the allocation rules displayed in 
the Cost Translation Matrix and stated in Cost Cate- 
gory Relations are applied. Some categories transpose 
in a one to one basis. Such a transposition results 
in a partial assignment into ARIES categories* 

In order to complete the allocation into ARIES 
categories; interviev/s will need to be conducted. 
Based upon these , a final statement of resource 
allocations to ARIES categories can be produced. 
Through application of any set of wages and prices^ 
those actual to NWREL are those representative of 
adopter expectations ^ the final distr.i bution of cost 
can be determined. From that, estimates of operational 
cost can be provided and compared to existing estimates. 

If one v;ishes to go further and attempt estimates 
at changed scales or configurations of operation, it 
will be necessary to dotermine the optimal ratios of 
resources to one another and/or the upper and lower 
(a range) of ratio values judged as acceptable. 

This data either must be incorporated into the 
initial interviews or a second set of interviews must 
be conducted. A reduced set of people need be con- 
tacted however. 



Schematic Description of Work 




Present 
Reports 



[Identify All 
Transactions 
By NWREL 
Category 



Original Source 
Documents 



Physical Allocations | 
of 

Individual Resources 
NWREL Category 



Tentative and Partial 
Assignment of 
Resources to ARIES 
Categories 



NOTE: Some minor 

resources will 
not be expressed 
in physical 
units. Insteadi 
dollar measuresj 
will be 
employed. 



Conduct of Interview 
(Estimation of Resource 
Allocation Percents) 



Application of 
Interview Results 
to Determine Physical 
Allocation to ARIES 
Categories 
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Application of 
Prices to Obtain 
Estimate 
of Cost 
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Interviews 



The attached statement gives some indication of the 
interviews to be conducted. 

A. P REPAINT I OM 

Prior to conducting any staff interview/ the resource 
allocation to NWREL categories must bo retrieved 
from the original documents. This information is 
the starting point. 

B. Cv-DNDUCT OF INTERVIEW 

1. We start by stating our purpose and what we 
found in original records. We work from the 
old classification through activities to the 
new categories. 

2. My suggestion is to discuss with the individual 
how the subject resource (e.g., staff time) is 
used. Roughly, T ask, V'Jhat Is It That You Do? 

3. As that is discussed, I note the kinds of 
activities which are mentioned and try to make 
associations v;ith the generalized conceptual 
terms v/hich I have already in mind. 

4. I would suggest verifying the associations with 
the individual. We ask. Taking the meaning of 
the general term as follows, would you agree 
that what you have described is properly assign- 
ed to that term? The result is (1) a descrip- 
tion of iiow the resouioe is employed in the 
terms of the person describing its use and (2) 

a mapping from his terms, which v;ill differ 
from person to person, into our terms, which 
are general across the project. 

5. The next step is to associate quantities with 
the activities discussed. Often it is pre- 
ferable to require quantities expressed in the 
units of measure associated with the resource 
(e.g., hours). IIov;ever, in this case, where v;e 
are recollecting over an extended period of 
time and that from a distant point of time, it 
may be more- practical to seek the relative 
quantity - percent - of resource employment 
devoted to the activity. 

C. APPLICATIOM 

The quantities or the percents are compared or 
applied to the values found on the original documents. 
The estimates to be placed in our illustrative report 
are derived from the comparisons or applications. 

D. TIME 

The time required for such an interviev; is h:\td to 
estimate. Hov/over, for nonsupervisory staff, I would 
estimate 2 hours as the outside maximum. 
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